Skip to content
This repository has been archived by the owner on Sep 18, 2024. It is now read-only.

Dev nas interface -- document #1049

Merged

Conversation

QuanluZhang
Copy link
Contributor

No description provided.

Copy link

@gaocegege gaocegege left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Awesome proposal! Really looking forward to it.


![](../img/nas_weight_share.png)

We believe weight sharing (transferring) plays a key role on speeding up NAS, while finding efficient ways of sharing weights is still a hot research topic. We provide a key-value store for users to store and load weights. Tuners and Trials use a provided KV client lib to access the storage.

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I have a question here.

Is the feature invasive for user code? Do the users need to write the CRUD KV store logic in their code?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, we provide CRUD KV interface to users, this is kind of lower level APIs. To make programming more convenient, we may provide higher level APIs which are wrappers of CRUD KV logic. The detailed design will be refactored during supporting one-shot NAS algorithms.

@QuanluZhang QuanluZhang merged commit 6682939 into microsoft:dev-nas-interface May 8, 2019
xuehui1991 pushed a commit that referenced this pull request May 28, 2019
* Dev nas interface -- document (#1049)

* nas interface doc

* Dev nas compile -- code generator (#1067)

* finish code for parsing mutable_layers annotation and testcode

* Dev nas interface -- update figures (#1070)

 update figs

* update searchspace_generator (#1071)

* GeneralNasInterfaces.md: Fix a typo (#1079)

Signed-off-by: Ce Gao <gaoce@caicloud.io>

* add NAS example and fix bugs (#1083)

update searchspace_generator, add example, update NAS example

* fix bugs (#1108)

* Remove NAS example (#1116)

 remove example

* update (#1119)

* Dev nas interface2 (#1121)

update doc

* Fix comment for pr of nas (#1122)

 resolve comment
xuehui1991 pushed a commit that referenced this pull request Jun 3, 2019
* Dev nas interface -- document (#1049)

* nas interface doc

* Dev nas compile -- code generator (#1067)

* finish code for parsing mutable_layers annotation and testcode

* Dev nas interface -- update figures (#1070)

 update figs

* update searchspace_generator (#1071)

* GeneralNasInterfaces.md: Fix a typo (#1079)

Signed-off-by: Ce Gao <gaoce@caicloud.io>

* add NAS example and fix bugs (#1083)

update searchspace_generator, add example, update NAS example

* fix bugs (#1108)

* nas example

* fix bugs

* remove

* update

* debug

* fix bug

* remove previous mnist.py

* rename

* code gen for specific trial

* fix conflict

* remove print

* add print warning

* update doc

* update doc

* update doc

* remove comment

* update doc

* remove unnecessary global
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants