Skip to content

[Bugfix][Model] OLMo 2: split qkv correctly for GQA and MQA#13687

Merged
simon-mo merged 1 commit intovllm-project:mainfrom 2015aroras:shanea/olmo2-fix-qkv-sizesFeb 22, 2025

Commits

Commits on Feb 21, 2025