You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When users pass an ObjectRef as a UDF parameter. It's supposed to be automatically deref'ed
defmap_fn(arg):
# The following is broken right now.# assert arg == 1# Instead, users need to usearg=ray.get(arg)
arg_ref=ray.put(1)
ds.map(map_fn, fn_args=[arg_ref])
This bug hurts both user experience and performance.
Because the UDF arguments are not passed as the Ray task arguments.
So Ray Scheduler doesn't know if the arguments are ready or not, before scheduling the tasks.
The text was updated successfully, but these errors were encountered:
raulchen
added
bug
Something that is supposed to be working; but isn't
P1
Issue that should be fixed within a few weeks
data
Ray Data-related issues
labels
Dec 11, 2024
## Why are these changes needed?
This PR enables passing kwargs to map tasks, which will be accessible
via `TaskContext.kwargs`.
This is a prerequisite to fixing
#49207. And optimization rules
can use this API to pass additional arguments to the map tasks.
---------
Signed-off-by: Hao Chen <chenh1024@gmail.com>
## Why are these changes needed?
This PR enables passing kwargs to map tasks, which will be accessible
via `TaskContext.kwargs`.
This is a prerequisite to fixing
ray-project#49207. And optimization rules
can use this API to pass additional arguments to the map tasks.
---------
Signed-off-by: Hao Chen <chenh1024@gmail.com>
## Why are these changes needed?
This PR enables passing kwargs to map tasks, which will be accessible
via `TaskContext.kwargs`.
This is a prerequisite to fixing
ray-project#49207. And optimization rules
can use this API to pass additional arguments to the map tasks.
---------
Signed-off-by: Hao Chen <chenh1024@gmail.com>
Signed-off-by: ujjawal-khare <ujjawal.khare@dream11.com>
When users pass an ObjectRef as a UDF parameter. It's supposed to be automatically deref'ed
This bug hurts both user experience and performance.
Because the UDF arguments are not passed as the Ray task arguments.
So Ray Scheduler doesn't know if the arguments are ready or not, before scheduling the tasks.
The text was updated successfully, but these errors were encountered: