🚨🚨 Setting default behavior of assisted decoding#33657

Merged

gante merged 8 commits intohuggingface:mainfrom jmamou:default-SL

Sep 25, 2024

+24-8

Commits on Sep 25, 2024

setting default to Dynamic number of speculative tokens

jmamou
authored and
gante
committed
add test

jmamou
authored and
gante
committed
fix style

jmamou
authored and
gante
committed
add is_assistant config

jmamou
authored and
gante
committed
fix style

jmamou
authored and
gante
committed
fix tests

jmamou
authored and
gante
committed
moving is_assistant = True from utils.generate to candidate_generator

jmamou
authored and
gante
committed
Update src/transformers/generation/utils.py

jmamou
and
gante
committed