Code

schedulefree optimizers#30079

Code

Merged

LysandreJik merged 12 commits intohuggingface:mainhuggingface/transformers:mainfrom winglian:schedule-free-optimizerwinglian/transformers:schedule-free-optimizerCopy head branch name to clipboardSep 9, 2024

+124

Commits

Commits on Sep 6, 2024

• schedulefree optimizers

  winglian

  committed
  f515776

  Copy full SHA for f515776

• fix train instead of eval for optimizer

  winglian

  committed
  1b95027

  Copy full SHA for 1b95027

• fixes and update docs

  winglian

  committed
  40afb0d

  Copy full SHA for 40afb0d

• chore: lint

  winglian

  committed
  2245f57

  Copy full SHA for 2245f57

• add tests and drop overly-verbose _32bit suffix

  winglian

  committed
  75c68e6

  Copy full SHA for 75c68e6

• chore: lint

  winglian

  committed
  83ca40b

  Copy full SHA for 83ca40b

• fix for docs

  winglian

  committed
  e5f5bce

  Copy full SHA for e5f5bce

• fix code review issues

  

  tmm1

  authored and

  winglian

  committed
  1145ede

  Copy full SHA for 1145ede

• use duck-typing to avoid per-optimizer patches

  

  tmm1

  authored and

  winglian

  committed
  367ac00

  Copy full SHA for 367ac00

• fixup style

  

  tmm1

  authored and

  winglian

  committed
  2e857a8

  Copy full SHA for 2e857a8

• fixup style

  

  tmm1

  authored and

  winglian

  committed
  179232c

  Copy full SHA for 179232c

Commits on Sep 7, 2024

• warn if incorrect accelerate version with schedule free

  Show description for 975f045
  

  winglian

  and

  tmm1

  authored
  975f045

  Copy full SHA for 975f045