-
Notifications
You must be signed in to change notification settings - Fork 1.8k
Dev nas interface -- document #1049
Dev nas interface -- document #1049
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Awesome proposal! Really looking forward to it.
|
||
 | ||
|
||
We believe weight sharing (transferring) plays a key role on speeding up NAS, while finding efficient ways of sharing weights is still a hot research topic. We provide a key-value store for users to store and load weights. Tuners and Trials use a provided KV client lib to access the storage. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I have a question here.
Is the feature invasive for user code? Do the users need to write the CRUD KV store logic in their code?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Yes, we provide CRUD KV interface to users, this is kind of lower level APIs. To make programming more convenient, we may provide higher level APIs which are wrappers of CRUD KV logic. The detailed design will be refactored during supporting one-shot NAS algorithms.
* Dev nas interface -- document (#1049) * nas interface doc * Dev nas compile -- code generator (#1067) * finish code for parsing mutable_layers annotation and testcode * Dev nas interface -- update figures (#1070) update figs * update searchspace_generator (#1071) * GeneralNasInterfaces.md: Fix a typo (#1079) Signed-off-by: Ce Gao <gaoce@caicloud.io> * add NAS example and fix bugs (#1083) update searchspace_generator, add example, update NAS example * fix bugs (#1108) * Remove NAS example (#1116) remove example * update (#1119) * Dev nas interface2 (#1121) update doc * Fix comment for pr of nas (#1122) resolve comment
* Dev nas interface -- document (#1049) * nas interface doc * Dev nas compile -- code generator (#1067) * finish code for parsing mutable_layers annotation and testcode * Dev nas interface -- update figures (#1070) update figs * update searchspace_generator (#1071) * GeneralNasInterfaces.md: Fix a typo (#1079) Signed-off-by: Ce Gao <gaoce@caicloud.io> * add NAS example and fix bugs (#1083) update searchspace_generator, add example, update NAS example * fix bugs (#1108) * nas example * fix bugs * remove * update * debug * fix bug * remove previous mnist.py * rename * code gen for specific trial * fix conflict * remove print * add print warning * update doc * update doc * update doc * remove comment * update doc * remove unnecessary global
No description provided.