Code

Add Mixtral-8x22B#1845

Code

Merged

Andrei-Aksionov merged 6 commits intoLightning-AI:mainLightning-AI/litgpt:mainfrom ysjprojects:mixtral8x22bysjprojects/litgpt:mixtral8x22bCopy head branch name to clipboardDec 2, 2024

+32-5

Commits

Commits on Nov 30, 2024

• Add Mixtral-8x22B

  ysjprojects

  committed
  8a9b0ba

  Copy full SHA for 8a9b0ba

• Update README.md

  ysjprojects

  authored
  9dc5d45

  Copy full SHA for 9dc5d45

• Update README.md

  ysjprojects

  authored
  b94bf90

  Copy full SHA for b94bf90

• Mixtral-8x22B fix: added n_embd

  ysjprojects

  committed
  319f462

  Copy full SHA for 319f462

• Mixtral-8x22B minor vocab_size fix

  ysjprojects

  committed
  191aa34

  Copy full SHA for 191aa34

Commits on Dec 2, 2024

• Merge branch 'main' into mixtral8x22b

  Andrei-Aksionov

  authored
  b044fad

  Copy full SHA for b044fad