Code

Fix: FA2 with packed training#32487

Code

Merged

zucchini-nlp merged 5 commits intohuggingface:mainhuggingface/transformers:mainfrom zucchini-nlp:flash-attn-fixeszucchini-nlp/transformers:flash-attn-fixesCopy head branch name to clipboardAug 12, 2024

+120-6

Commits

Commits on Aug 7, 2024

• fix check

  zucchini-nlp

  committed
  52bab19

  Copy full SHA for 52bab19

Commits on Aug 8, 2024

• Merge remote-tracking branch 'upstream/main' into flash-attn-fixes

  zucchini-nlp

  committed
  d96e4b0

  Copy full SHA for d96e4b0

• add tests

  zucchini-nlp

  committed
  bfe11ad

  Copy full SHA for bfe11ad

• [run-slow] llama, gemma2

  zucchini-nlp

  committed
  4b49c85

  Copy full SHA for 4b49c85

Commits on Aug 9, 2024

• oops, whisper actually runs but needed some special treatment

  zucchini-nlp

  committed
  bdcf2cb

  Copy full SHA for bdcf2cb