Fix incorrect prompt tokenization in speculative example#4025

Merged

ggerganov merged 3 commits intoggerganov:masterfrom AutonomicPerfectionist:fix-speculative-prompt-processing

Nov 20, 2023

+15-2

Commits on Nov 18, 2023

Support special tokens and not adding BOS to prompt in speculative
AutonomicPerfectionist
committed
Adapt to new should_add_bos function
AutonomicPerfectionist
committed
Ensure tgt and dft have same add_bos setting
AutonomicPerfectionist
committed