Skip to content

Commit

Permalink
Update vllm/attention/backends/mla/utils.py
Browse files Browse the repository at this point in the history
Co-authored-by: Tyler Michael Smith <tysmith@redhat.com>
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
  • Loading branch information
LucasWilkinson and tlrmchlsmth committed Jan 30, 2025
1 parent 09d814c commit 4a46014
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion vllm/attention/backends/mla/utils.py
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@

@dataclass(kw_only=True)
class MLAMetadataCommon(AttentionMetadata):
# Input positions for rotrary embeddings since for MLA the rotarty
# Input positions for rotrary embeddings since for MLA the rotary
# position embeddings are applied inside the attention backend
input_positions: torch.Tensor

Expand Down

0 comments on commit 4a46014

Please sign in to comment.