Skip to content
This repository has been archived by the owner on Sep 18, 2024. It is now read-only.

Add BOHB Advisor #910

Merged
merged 64 commits into from
Apr 12, 2019
Merged

Add BOHB Advisor #910

merged 64 commits into from
Apr 12, 2019

Conversation

PurityFan
Copy link
Contributor

@PurityFan PurityFan commented Mar 25, 2019

  • Add BOHB Advisor
  1. Add new advisor with new algorithm BOHB, reference paper: https://arxiv.org/abs/1807.01774
  2. Add MNIST example of BOHB usage
  3. Add related docs and links

@leelaylay
Copy link
Contributor

leelaylay commented Apr 3, 2019

@PurityFan I have one simple suggestion that you can change the _KEY = 'TRIAL_BUDGET' to _KEY = 'STEPS'(Hyperband uses this name).

@PurityFan
Copy link
Contributor Author

@PurityFan I have one simple suggestion that you can change the _KEY = 'TRIAL_BUDGET' to _KEY = 'STEPS'(Hyperband uses this name).

We decided to change the “STEPS” uniform to “TRIAL_BUDGET” at the previous meeting.

@leelaylay
Copy link
Contributor

I can run it successfully. Hope for approval.

Copy link
Contributor

@QuanluZhang QuanluZhang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

doc can be further improved

@xuehui1991
Copy link
Contributor

I suggest that more people to review this big PR.

for var in search_space:
_type = str(search_space[var]["_type"])
if _type == 'choice':
cs.add_hyperparameter(CSH.CategoricalHyperparameter(
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

would be better if we could leverage existing config parsing code.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

BOHB needs to use the functions in ConfigSpace, this function is to convert the format represented by nni into a format that can be recognized in the ConfigSpace package. Not clear of how to leverage existing config parsing code?

@QuanluZhang QuanluZhang merged commit 5aca94d into microsoft:master Apr 12, 2019
@PurityFan PurityFan mentioned this pull request Apr 15, 2019
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants