Skip to content

Commit

Permalink
better description of indices variable in comment
Browse files Browse the repository at this point in the history
Signed-off-by: Yannick Schnider <Yannick.Schnider1@ibm.com>
  • Loading branch information
yannicks1 committed Jan 31, 2025
1 parent 3f087a7 commit fc09267
Showing 1 changed file with 3 additions and 1 deletion.
4 changes: 3 additions & 1 deletion vllm/model_executor/model_loader/spyre.py
Original file line number Diff line number Diff line change
Expand Up @@ -46,7 +46,9 @@ def __init__(
self.past_key_value_states = None
self.dtype = torch.float16 if envs.VLLM_SPYRE_DYNAMO_BACKEND == \
'sendnn_decoder' else torch.float32
# indices: True unfinished, False for finished or padded sequence
# boolean tensor of length batch size with indices:
# True for unfinished sequences and
# False for finished or padded sequences
self.indices = None

# Lazy initialized
Expand Down

0 comments on commit fc09267

Please sign in to comment.