Skip to content

Fix weigit loading for GQA with TP#2379

Merged
zhuohan123 merged 1 commit intovllm-project:mainfrom zhangch9:fix-gqa-tpJan 15, 2024
+4-1

Commits

Commits on Jan 8, 2024