Skip to content

Faster prompt eval w/ early exit after last layer's kv cache write#253

Closed
ochafik wants to merge 1 commit intokarpathy:masterfrom ochafik:early_exit_prompt_eval
+22-11

Commits

Commits on Aug 6, 2023