Skip to content
This repository has been archived by the owner on Sep 18, 2024. It is now read-only.

Provide command to show experiment only. #1414

Closed
squirrelsc opened this issue Aug 5, 2019 · 6 comments
Closed

Provide command to show experiment only. #1414

squirrelsc opened this issue Aug 5, 2019 · 6 comments

Comments

@squirrelsc
Copy link
Member

Currently, if user wants to look an experiment result, it have to use nnictl resume. It does some validation, and easy to fail. There should be a command like nnictl view experiment to start webui for view only.

@scarlett2018
Copy link
Member

@rabbit008 - please investigate and make a proposal for team discussion.

@mys007
Copy link

mys007 commented Sep 11, 2019

This would be a great feature to have! The major problem with nnictl resume for viewing previous experiments via WebUI is that it starts new trials as well if the experiment has been terminated prematurely.

@scarlett2018
Copy link
Member

Thanks @mys007 for the feedback, we are also collecting feedback for experiment comparision, would you like to share your view as well? #1529.

@SparkSnail
Copy link
Contributor

@squirrelsc If users use nnictl view experiment, should we let users change experiment parameters using webUI or nnictl command?

@squirrelsc
Copy link
Member Author

@squirrelsc If users use nnictl view experiment, should we let users change experiment parameters using webUI or nnictl command?

It depends. In general, when viewing an experiment, the experience data should be readonly. It means nothing is saved back to storage. But if there is any parameter impacting how an experiment showing, it could be able to changed. If there are some examples, feel free to let me know.

@liuzhe-lz
Copy link
Contributor

#1524

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

7 participants