Skip to content

Commit

Permalink
[requirements] Add PyArrow to ray[tune] dependencies (ray-project#34397)
Browse files Browse the repository at this point in the history
Ray Tune depends on PyArrow for filesyncing. However, `ray[tune]` currently does not include pyarrow as a dependency, which means version constraints are not enforced and syncing is not guaranteed to work out of the box.

This surfaced as a problem when a user used poetry with `ray[tune]` as a constraint, but an incompatible version of pyarrow was installed. In this case, syncing to cloud storage was broken.

Signed-off-by: Kai Fricke <kai@anyscale.com>
  • Loading branch information
krfricke authored and vitsai committed Apr 17, 2023
1 parent 358f3f4 commit 37ec95c
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion python/setup.py
Original file line number Diff line number Diff line change
Expand Up @@ -254,7 +254,7 @@ def get_packages(self):
"smart_open",
],
"serve": ["uvicorn", "requests", "starlette", "fastapi", "aiorwlock"],
"tune": ["pandas", "tabulate", "tensorboardX>=1.9", "requests"],
"tune": ["pandas", "tabulate", "tensorboardX>=1.9", "requests", pyarrow_dep],
"k8s": ["kubernetes", "urllib3"],
"observability": [
"opentelemetry-api",
Expand Down

0 comments on commit 37ec95c

Please sign in to comment.