Skip to content
This repository has been archived by the owner on Nov 15, 2021. It is now read-only.

Merge with ray master #36

Merged
merged 131 commits into from
Jun 26, 2019
Merged

Merge with ray master #36

merged 131 commits into from
Jun 26, 2019

Conversation

stefanpantic
Copy link

Merge with ray master

After 30 minutes:
image

Parameters:

python wgym.py train --logdir ./logs/pls_work_v16 --stop_value 1600 --num_samples 1000 WGYM_APPO_POLICY --observation_filter MeanStdFilter --train_batch_size 16000 --sample_batch_size 50 --lr 0.003 --entropy_coeff 0.001 --num_workers 12 --grad_clip 30 RLLIB_MODEL --model fully_connected GOAL_EPISODES_ENV_LAYER --steps_reward 0.0 CLEVR_REMOTE_ENV --num_objects 4 --headless --logical_envs_per_physical_env 128

ericl and others added 30 commits May 10, 2019 20:36
@ericl
[rllib] Remove dependency on TensorFlow (ray-project#4764)
351753a 
* remove hard tf dep

* add test

* comment fix

* fix test
@romilbhardwaj @raulchen
Dynamic Custom Resources - create and delete resources (ray-project#3742
004440f 
)
@robertnishihara
Update tutorial link in doc (ray-project#4777)
f3b8b90
@ericl
[rllib] Implement learn_on_batch() in torch policy graph
69352e3
@jovany-wang @raulchen
Fix ray stop by killing raylet before plasma (ray-project#4778)
62c949b
@stephanie-wang @robertnishihara
Fatal check if object store dies (ray-project#4763)
1622fc2
@joneswong @ericl
[rllib] fix clip by value issue as TF upgraded (ray-project#4697)
c5161a2 
*  fix clip_by_value issue

*  fix typo
@stefanpantic
Merge with ray master
67af103
@richardliaw
[autoscaler] Fix submit (ray-project#4782)
3bbafc7
@stefanpantic
Merge with master
d6bf680
@stephanie-wang
Queue tasks in the raylet in between async callbacks (ray-project#4766)
cb1a195 
* Add a SWAP TaskQueue so that we can keep track of tasks that are temporarily dequeued

* Fix bug where tasks that fail to be forwarded don't appear to be local by adding them to SWAP queue

* cleanups

* updates

* updates
@raulchen
[Java][Bazel] Refine auto-generated pom files (ray-project#4780)
643f62d
@devin-petersohn @robertnishihara
Bump version to 0.7.0 (ray-project#4791)
1490a98
[JAVA] setDefaultUncaughtExceptionHandler to log uncaught exception i…
98dd033 
…n user thread. (ray-project#4798)

* Add WorkerUncaughtExceptionHandler

* Fix

* revert bazel and pom
@richardliaw @robertnishihara
[tune] Fix CLI test (ray-project#4801)
9f2645d
@raulchen
Fix pom file generation (ray-project#4800)
ffd596d
@ericl
[rllib] Support continuous action distributions in IMPALA/APPO (ray-p…
7d5ef6d 
…roject#4771)
@ericl
[rllib] TensorFlow 2 compatibility (ray-project#4802)
3807fb5
@pcmoritz @suquark
Change tagline in documentation and README. (ray-project#4807)
84cf474 
* Update README.rst, index.rst, tutorial.rst and  _config.yml
@richardliaw
[tune] Support non-arg submit (ray-project#4803)
ffe61fc
@richardliaw
[autoscaler] rsync cluster (ray-project#4785)
88b45a5
@richardliaw
[tune] Remove extra parsing functionality (ray-project#4804)
e20855c
@jovany-wang @guoyuhong
Fix Java worker log dir (ray-project#4781)
dcd6d49
@noahgolmant @richardliaw
[tune] Initial track integration (ray-project#4362)
1ef9c07 
Introduces a minimally invasive utility for logging experiment results. A broad requirement for this tool is that it should integrate seamlessly with Tune execution.
@ericl
[rllib] [RFC] Dynamic definition of loss functions and modularization…
6cb5b90 
… support (ray-project#4795)

* dynamic graph

* wip

* clean up

* fix

* document trainer

* wip

* initialize the graph using a fake batch

* clean up dynamic init

* wip

* spelling

* use builder for ppo pol graph

* add ppo graph

* fix naming

* order

* docs

* set class name correctly

* add torch builder

* add custom model support in builder

* cleanup

* remove underscores

* fix py2 compat

* Update dynamic_tf_policy_graph.py

* Update tracking_dict.py

* wip

* rename

* debug level

* rename policy_graph -> policy in new classes

* fix test

* rename ppo tf policy

* port appo too

* forgot grads

* default policy optimizer

* make default config optional

* add config to optimizer

* use lr by default in optimizer

* update

* comments

* remove optimizer

* fix tuple actions support in dynamic tf graph
@pimpke
Merge remote-tracking branch 'remotes/main/master' into unstable
04294d9
@ericl @richardliaw
[rllib] Rename PolicyGraph => Policy, move from evaluation/ to policy/ (
02583a8 
ray-project#4819)

This implements some of the renames proposed in ray-project#4813
We leave behind backwards-compatibility aliases for *PolicyGraph and SampleBatch.
@jovany-wang @suquark
[Java] Dynamic resource API in Java (ray-project#4824)
081708b
@stefanpantic
Merge with master
ac47d03
@stefanpantic
Add default values for Wgym flags
5391b61
zhijunfu and others added 28 commits June 14, 2019 18:35
@zhijunfu @raulchen
[Core worker] add store & task provider (ray-project#4966)
37abdb2
@TianhongDai @ericl
Fix bugs in the a3c code template. (ray-project#4984)
1b86e55
@simon-mo @pcmoritz
Inherit Function Docstrings and other metedata (ray-project#4985)
05e2748
@jovany-wang @raulchen
Fix a crash when unknown worker registering to raylet (ray-project#4992)
b08765a
@raulchen
[gRPC] Use gRPC for inter-node-manager communication (ray-project#4968)
2bf92e0
@stefanpantic
Merge branches 'master' and 'unstable' of github.com:wingman-ai/ray i…
d81c126 
…nto unstable
@stefanpantic
Merge with ray master
2e0eec9
@jovany-wang @raulchen
Fix Java CI failure (ray-project#4995)
7bda5ed
@rueberger @pcmoritz
fix handling of non-integral timeout values in signal.receive (ray-pr…
e59e807 
…oject#5002)
@ericl @pcmoritz
temp fix for build (ray-project#5006)
1d17125
@richardliaw
[tune] Tutorial UX Changes (ray-project#4990)
31b6da1 
* add integration, iris, ASHA, recursive changes, set reuse_actors=True, and enable Analysis as a return object

* docstring

* fix up example

* fix

* cleanup tests

* experiment analysis
@pcmoritz @robertnishihara
Fix valgrind build by installing new version of valgrind (ray-project…
3b23d94 
…#5008)
@jiangzihao2009 @raulchen
Fix no cpus test (ray-project#5009)
a7f84b5
@pcmoritz @ericl
Fix tensorflow-1.14 installation in jenkins (ray-project#5007)
2e342ef
@jovany-wang
Add dynamic worker options for worker command. (ray-project#4970)
e33d0ea 
* Add fields for fbs

* WIP

* Fix complition errors

* Add java part

* FIx

* Fix

* Fix

* Fix lint

* Refine API

* address comments and add test

* Fix

* Address comment.

* Address comments.

* Fix linting

* Refine

* Fix lint

* WIP: address comment.

* Fix java

* Fix py

* Refin

* Fix

* Fix

* Fix linting

* Fix lint

* Address comments

* WIP

* Fix

* Fix

* minor refine

* Fix lint

* Fix raylet test.

* Fix lint

* Update src/ray/raylet/worker_pool.h

Co-Authored-By: Hao Chen <chenh1024@gmail.com>

* Update java/runtime/src/main/java/org/ray/runtime/AbstractRayRuntime.java

Co-Authored-By: Hao Chen <chenh1024@gmail.com>

* Address comments.

* Address comments.

* Fix test.

* Update src/ray/raylet/worker_pool.h

Co-Authored-By: Hao Chen <chenh1024@gmail.com>

* Address comments.

* Address comments.

* Fix

* Fix lint

* Fix lint

* Fix

* Address comments.

* Fix linting
@kiddyboots216 @richardliaw
[docs] docs for running Tensorboard without sudo (ray-project#5015)
11ccf66 
* Instructions for running Tensorboard without sudo

When we run Tensorboard to visualize the results of Ray outputs on multi-user clusters where we don't have sudo access, such as RISE clusters, a few commands need to first be run to make sure tensorboard can edit the tmp directory. This is a pretty common usecase so I figured we may as well put it in the documentation for Tune.

* Update tune-usage.rst
@richardliaw @pcmoritz
[ci] Change Jenkins to py3 (ray-project#5022)
bd8aceb 
* conda3

* integration

* add nevergrad, remotedata

* pytest 0.3.1

* otherdockers

* setup

* tune
@raulchen @pcmoritz
[gRPC] Migrate gcs data structures to protobuf (ray-project#5024)
0131353
@ericl
[rllib] Add QMIX mixer parameters to optimizer param list (ray-projec…
aa5fc52 
…t#5014)

* add mixer params

* Update qmix_policy.py
@zhijunfu @pcmoritz
[grpc] refactor rpc server to support multiple io services (ray-proje…
bb8e75b 
…ct#5023)
@pcmoritz @ericl
[rllib] Give error if sample_async is used with pytorch for A3C (ray-…
bbe3e5b 
…project#5000)

* give error if sample_async is used with pytorch

* update

* Update a3c.py
@richardliaw
[tune] Update MNIST Example (ray-project#4991)
b1827d5
@stefanpantic
Add entropy coeff schedule
d639737
@stefanpantic
Merge with ray master
108bfa2
@stefanpantic
Revert "Merge with ray master"
92c0f88 
This reverts commit 108bfa2, reversing
changes made to 2e0eec9.
@stefanpantic
Revert "Revert "Merge with ray master""
014cbb7 
This reverts commit 92c0f88.
@stefanpantic
Remove entropy decay stuff
342854b
@stefanpantic
Merge branches 'master' and 'unstable' of github.com:wingman-ai/ray i…
17d1009 
…nto unstable
@stefanpantic stefanpantic merged commit 110aaab into master Jun 26, 2019
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Reviewers

@nikola-j nikola-j nikola-j approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.