[Bug] Fixed the yaml of deployments in heterogenous GPU settings to make KPA scaling work as expected.#513
Merged
Jeffwan merged 1 commit intomainfrom issues/507_KPA_scaling_results_in_heterogeneous_GPUDec 10, 2024
+3
Commits
Commits on Dec 10, 2024
- committed
Jingyuan Zhang