Base model management in runtime for Orchestrator #4215
Labels
Area: Orchestrator
feature-request
A request for new functionality or an enhancement to an existing one.
P1
Painful if we don't fix, won't block releasing
Team: Platform
Milestone
Related to #4209.
Given the size of base model is pretty large (400+ MB for one language), it makes sense to let Composer app and runtime both manage it's own model downloading, saving, refering without have to exchange base model(s).
This ticket to track the work on runtime side, including
The runtime effort needs to consider a few others scenarios
The text was updated successfully, but these errors were encountered: