[Backend support] Allow num_logits_to_keep as Tensor and change it to logits_to_keep + add flag#35757
Merged
Cyrilvallez merged 7 commits intomainfrom tgi-supportJan 23, 2025
+603-315
Commits
Commits on Jan 21, 2025
- committed
- committed
- committed
- committed
- committed
- committed
- committed