Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[rllib] MultiDiscrete action distributions aren't handled correctly in all algorithms #4866

Closed
ericl opened this issue May 25, 2019 · 0 comments · Fixed by #4869
Closed

[rllib] MultiDiscrete action distributions aren't handled correctly in all algorithms #4866

ericl opened this issue May 25, 2019 · 0 comments · Fixed by #4869
Assignees

Comments

@ericl
Copy link
Contributor

ericl commented May 25, 2019

Describe the problem

Currently only IMPALA and APPO handle MultiDiscrete properly. We should fix this or raise an error telling users to use Tuple instead.

As a workaround, you can use Tuple[Discrete, Discrete, ...] instead of MultiDiscrete.

Source code / logs

This is from https://groups.google.com/forum/#!topic/ray-dev/RaqWO89Rl6E

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant