Make `Dagger.finish_stream()` propagate downstream#579

Closed

JamesWrigley wants to merge 56 commits intojps/stream2from finish-stream

+1,844-83

Commits on Nov 15, 2024

Add metadata to EagerThunk

jpsamaroo
authored and
JamesWrigley
committed
Sch: Allow occupancy key to be Any

jpsamaroo
authored and
JamesWrigley
committed
Add streaming API

jpsamaroo
authored and
JamesWrigley
committed
Reference Dagger.EAGER_THUNK_STREAMS explicitly
JamesWrigley
committed
Use Base.promote_op() instead of Base._return_type()
JamesWrigley
committed
Special-case StreamingFunction in EagerThunkMetadata() constructor
JamesWrigley
committed
Fix reference to task-queues.md in the docs
JamesWrigley
committed
Delete Dagger.cleanup()
JamesWrigley
committed
streaming: Show thunk ID in logs

jpsamaroo
authored and
JamesWrigley
committed
streaming: Add tests

jpsamaroo
authored and
JamesWrigley
committed
Use procs() when initializing EAGER_CONTEXT
JamesWrigley
committed
streaming: Fix concurrency issues

jpsamaroo
authored and
JamesWrigley
committed
Add a --verbose option to runtests.jl
JamesWrigley
committed
Ensure that stream_fetch_values!() yields in its loop
JamesWrigley
committed
Add support for limiting the evaluations of a streaming DAG
JamesWrigley
committed
Dev the migration-helper branch of MemPool.jl
JamesWrigley
committed
Minor style cleanup
JamesWrigley
committed
Use DTaskFailedException and increase the default timeout
JamesWrigley
committed
Initial support for robustly migrating streaming tasks
JamesWrigley
committed
Inherit the top-level testsets in the streaming tests
JamesWrigley
committed
Replace rand_finite() with a deterministic Producer functor
JamesWrigley
committed
fixup! Initial support for robustly migrating streaming tasks
JamesWrigley
committed
fixup! fixup! Initial support for robustly migrating streaming tasks

jpsamaroo
authored and
JamesWrigley
committed
task-tls: Refactor into DTaskTLS struct

jpsamaroo
authored and
JamesWrigley
committed
fixup! task-tls: Refactor into DTaskTLS struct

jpsamaroo
authored and
JamesWrigley
committed
cancellation: Add cancel token support

jpsamaroo
authored and
JamesWrigley
committed
streaming: Handle cancellation

jpsamaroo
authored and
JamesWrigley
committed
fixup! cancellation: Add cancel token support

jpsamaroo
authored and
JamesWrigley
committed
fixup! fixup! fixup! Initial support for robustly migrating streaming tasks

jpsamaroo
authored and
JamesWrigley
committed
Sch: Add unwrap_nested_exception for DTaskFailedException

jpsamaroo
authored and
JamesWrigley
committed
ProcessRingBuffer: Add length method

jpsamaroo
authored and
JamesWrigley
committed
fixup! fixup! cancellation: Add cancel token support

jpsamaroo
authored and
JamesWrigley
committed
streaming: Buffers and tasks per input/output

jpsamaroo
authored and
JamesWrigley
committed
fixup! fixup! fixup! cancellation: Add cancel token support

jpsamaroo
authored and
JamesWrigley
committed
Sch: Trigger cancel token on task exit

jpsamaroo
authored and
JamesWrigley
committed
Add task_id for DTask

jpsamaroo
authored and
JamesWrigley
committed
ProcessRingBuffer: Allow closure

jpsamaroo
authored and
JamesWrigley
committed
RemoteFetcher: Only collect values up to free buffer space

jpsamaroo
authored and
JamesWrigley
committed
streaming: Close buffers on closing StreamStore

jpsamaroo
authored and
JamesWrigley
committed
task-tls: Tweaks and fixes, task_id helper

jpsamaroo
authored and
JamesWrigley
committed
task-tls: Add task_cancel!

jpsamaroo
authored and
JamesWrigley
committed
streaming: max_evals cannot be specified as 0

jpsamaroo
authored and
JamesWrigley
committed
streaming: Small tweaks to migration and cancellation

jpsamaroo
authored and
JamesWrigley
committed
dagdebug: Always yield to avoid heisenbugs

jpsamaroo
authored and
JamesWrigley
committed
tests: Revamp streaming tests

jpsamaroo
authored and
JamesWrigley
committed
tests: Add offline mode

jpsamaroo
authored and
JamesWrigley
committed
dagdebug: Add JULIA_DAGGER_DEBUG config variable

jpsamaroo
authored and
JamesWrigley
committed
cancellation: Add graceful vs. forced

jpsamaroo
authored and
JamesWrigley
committed
cancellation: Wrap InterruptException in DTaskFailedException

jpsamaroo
authored and
JamesWrigley
committed
options: Add internal helper to strip all options

jpsamaroo
authored and
JamesWrigley
committed
streaming: Get tests passing

jpsamaroo
authored and
JamesWrigley
committed

Commits on Nov 16, 2024

Commits on Nov 17, 2024