Skip to content
This repository has been archived by the owner on Sep 18, 2024. It is now read-only.

[Retiarii] cross-graph optimization: device placement and input deduplication #3202

Merged
merged 110 commits into from
Jul 30, 2021

Conversation

hzhua
Copy link
Contributor

@hzhua hzhua commented Dec 16, 2020

No description provided.

hzhua added 30 commits November 19, 2020 08:33
learning_rate=learning_rate, weight_decay=weight_decay, optimizer=optimizer)


class Classification(Lightning):
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is it possible to inherit Classification and CgoMixin, to avoid copy all the code.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It seems to be hard. Most lines of code of Classification and Regression are documentation. The two lines of code in __init__ are both customized for CGO.

@@ -3,6 +3,7 @@

import atexit
import logging
from nni.retiarii.execution.logical_optimizer.logical_plan import PhysicalDevice
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggest add shortcut to simplify import

Copy link
Contributor

@ultmaster ultmaster left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It seems that most changes are self-contained and doesn't overlap with other modules. I suggest we merge this PR (as it's large enough) and we can improve later.

@hzhua
Copy link
Contributor Author

hzhua commented Jul 12, 2021

Since this PR depends on the modification of training service #3897 , I prefer not merging this PR before #3897 is merged.

@hzhua hzhua marked this pull request as draft July 12, 2021 09:00
@hzhua hzhua marked this pull request as ready for review July 27, 2021 14:55
@hzhua hzhua changed the title [Retiarii] cross-graph optimization: input deduplication [Retiarii] cross-graph optimization: device placement and input deduplication Jul 28, 2021
@QuanluZhang QuanluZhang merged commit f2f58db into microsoft:master Jul 30, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants