Code

support SDPA Attention in stablelm#29106

Code

Merged

younesbelkada merged 7 commits intohuggingface:mainhuggingface/transformers:mainfrom eaidova:ea/stablelm_sdpaeaidova/transformers:ea/stablelm_sdpaCopy head branch name to clipboardFeb 21, 2024

+168-1

Commits

Commits on Feb 19, 2024

• support SDPA Attention in stablelm

  eaidova

  committed
  8013317

  Copy full SHA for 8013317

Commits on Feb 20, 2024

• add integration test

  eaidova

  committed
  9986f40

  Copy full SHA for 9986f40

• add fallback for output_attentions

  eaidova

  committed
  3aa99e2

  Copy full SHA for 3aa99e2

• Update src/transformers/models/stablelm/modeling_stablelm.py

  Show description for bda2f14
  

  eaidova

  and

  ArthurZucker

  authored
  bda2f14

  Copy full SHA for bda2f14

• Update tests/models/stablelm/test_modeling_stablelm.py

  Show description for ce7c7d4
  

  eaidova

  and

  younesbelkada

  authored
  ce7c7d4

  Copy full SHA for ce7c7d4

• Update src/transformers/models/stablelm/modeling_stablelm.py

  Show description for 9bf6c62
  

  eaidova

  and

  younesbelkada

  authored
  9bf6c62

  Copy full SHA for 9bf6c62

Commits on Feb 21, 2024

• handle non-contiguous states

  eaidova

  committed
  4a03d87

  Copy full SHA for 4a03d87