Code

Re-enable SDPA's FA2 path#30070

Code

Merged

fxmarty merged 22 commits intohuggingface:mainhuggingface/transformers:mainfrom fxmarty:reenable-fa2-sdpafxmarty/transformers:reenable-fa2-sdpaCopy head branch name to clipboardApr 17, 2024

+176-60

Commits

Commits on Apr 5, 2024

• tentatively re-enable FA2 + SDPA

  fxmarty

  committed
  0f8e6ac

  Copy full SHA for 0f8e6ac

• better comment

  fxmarty

  committed
  8898595

  Copy full SHA for 8898595

• _ignore_causal_mask_sdpa as staticmethod

  fxmarty

  committed
  2471be2

  Copy full SHA for 2471be2

• type hints

  fxmarty

  committed
  fa14c73

  Copy full SHA for fa14c73

• use past_seen_tokens instead

  fxmarty

  committed
  76e75eb

  Copy full SHA for 76e75eb

• Merge branch 'main' into reenable-fa2-sdpa

  fxmarty

  committed
  9793add

  Copy full SHA for 9793add

• enable copied from for sdpa

  fxmarty

  committed
  eebfa09

  Copy full SHA for eebfa09

• ruff

  fxmarty

  committed
  701586e

  Copy full SHA for 701586e

Commits on Apr 8, 2024

• llama simplifications on review

  fxmarty

  committed
  0609b43

  Copy full SHA for 0609b43

• remove unnecessary self.is_causal check

  fxmarty

  committed
  3ca589d

  Copy full SHA for 3ca589d

• fix copies

  fxmarty

  committed
  471c101

  Copy full SHA for 471c101

• cleaning

  fxmarty

  committed
  7355555

  Copy full SHA for 7355555

• precise message

  fxmarty

  committed
  42692de

  Copy full SHA for 42692de

• better doc

  fxmarty

  committed
  3f92c7d

  Copy full SHA for 3f92c7d

• add test

  fxmarty

  committed
  c742e79

  Copy full SHA for c742e79

Commits on Apr 17, 2024

• Merge branch 'main' into reenable-fa2-sdpa

  fxmarty

  committed
  fbba245

  Copy full SHA for fbba245

• Merge branch 'main' into reenable-fa2-sdpa

  fxmarty

  committed
  4c41786

  Copy full SHA for 4c41786

• simplify

  fxmarty

  committed
  a94a441

  Copy full SHA for a94a441

• Update src/transformers/models/llama/modeling_llama.py

  Show description for 38fb6f6
  

  fxmarty

  and

  ArthurZucker

  authored
  38fb6f6

  Copy full SHA for 38fb6f6

• Update src/transformers/models/llama/modeling_llama.py

  Show description for 70d903f
  

  fxmarty

  and

  ArthurZucker

  authored
  70d903f

  Copy full SHA for 70d903f

• Update src/transformers/models/llama/modeling_llama.py

  Show description for 86e223e
  

  fxmarty

  and

  ArthurZucker

  authored
  86e223e

  Copy full SHA for 86e223e

• style

  fxmarty

  committed
  290a267

  Copy full SHA for 290a267