Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Base model management in runtime for Orchestrator #4215

Closed
4 tasks
boydc2014 opened this issue Sep 21, 2020 · 1 comment
Closed
4 tasks

Base model management in runtime for Orchestrator #4215

boydc2014 opened this issue Sep 21, 2020 · 1 comment
Assignees
Labels
Area: Orchestrator feature-request A request for new functionality or an enhancement to an existing one. P1 Painful if we don't fix, won't block releasing Team: Platform
Milestone

Comments

@boydc2014
Copy link
Contributor

Related to #4209.

Given the size of base model is pretty large (400+ MB for one language), it makes sense to let Composer app and runtime both manage it's own model downloading, saving, refering without have to exchange base model(s).

This ticket to track the work on runtime side, including

  • pick location to store base models
  • detect the base model version from bot assets
  • auto-download the base model when version detected
  • auto-update the model path to point to the location picked in step 1

The runtime effort needs to consider a few others scenarios

  1. the impact to azure deploying.
  2. the impact to ejecting\exporting runtime.
@boydc2014 boydc2014 added Type: Enhancement Needs-triage A new issue that require triage Area: Orchestrator Team: Platform and removed Needs-triage A new issue that require triage labels Sep 21, 2020
@hibrenda hibrenda added this to the R11 milestone Sep 21, 2020
@gabog gabog added feature-request A request for new functionality or an enhancement to an existing one. and removed Type: Enhancement labels Oct 6, 2020
@cwhitten cwhitten added the P1 Painful if we don't fix, won't block releasing label Oct 14, 2020
@cwhitten cwhitten modified the milestones: R11, R12 Nov 24, 2020
@boydc2014 boydc2014 reopened this Jan 19, 2021
@boydc2014
Copy link
Contributor Author

After checking with Tai and Leilei, we are closing this because we already implemented a solution that avoid unnecessary copy in local environment. For azure publishing, the best solution we are visioning, using a shared drived mounted in different web app instances, is not achievable at the moment, because Azure Blob\Files do not support Windows web app. No action needed at this moment.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Area: Orchestrator feature-request A request for new functionality or an enhancement to an existing one. P1 Painful if we don't fix, won't block releasing Team: Platform
Projects
None yet
Development

No branches or pull requests

4 participants