Code

Add support for Pixtral#33449

Code

Merged

ArthurZucker merged 62 commits intomainhuggingface/transformers:mainfrom add-pixtralhuggingface/transformers:add-pixtralCopy head branch name to clipboardSep 14, 2024

+2,707-2

Commits

Commits on Sep 12, 2024

• initial commit

  ArthurZucker

  committed
  2424d20

  Copy full SHA for 2424d20

• gloups

  ArthurZucker

  committed
  4780f37

  Copy full SHA for 4780f37

• updates

  ArthurZucker

  committed
  1b897b3

  Copy full SHA for 1b897b3

• work

  ArthurZucker

  committed
  1e97527

  Copy full SHA for 1e97527

• weights match

  ArthurZucker

  committed
  fb0e78c

  Copy full SHA for fb0e78c

• nits

  ArthurZucker

  committed
  eb76b0c

  Copy full SHA for eb76b0c

• nits

  ArthurZucker

  committed
  334d7a9

  Copy full SHA for 334d7a9

• updates to support the tokenizer :)

  ArthurZucker

  committed
  30439a1

  Copy full SHA for 30439a1

• updates

  ArthurZucker

  committed
  6544127

  Copy full SHA for 6544127

Commits on Sep 13, 2024

• Pixtral processor (#33454)

  Show description for a45122b
  amyeroberts

  authored
  a45122b

  Copy full SHA for a45122b

• Fix token expansion

  amyeroberts

  authored
  b6db4ee

  Copy full SHA for b6db4ee

• nit in conversion script

  ArthurZucker

  committed
  b8df95d

  Copy full SHA for b8df95d

• Merge branch 'add-pixtral' of github.com:huggingface/transformers into add-pixtral

  ArthurZucker

  committed
  a6443bd

  Copy full SHA for a6443bd

• Fix image token list creation

  amyeroberts

  authored
  185c435

  Copy full SHA for 185c435

• done

  ArthurZucker

  committed
  92c2735

  Copy full SHA for 92c2735

• add expected results

  ArthurZucker

  committed
  ea2d9fb

  Copy full SHA for ea2d9fb

• Process list of list of images (#33465)

  amyeroberts

  authored
  6ee62a7

  Copy full SHA for 6ee62a7

• updates

  ArthurZucker

  committed
  5f33680

  Copy full SHA for 5f33680

• working image and processor

  ArthurZucker

  committed
  cc18d88

  Copy full SHA for cc18d88

• this is the expected format

  ArthurZucker

  committed
  f04075e

  Copy full SHA for f04075e

• some fixes

  ArthurZucker

  committed
  732071b

  Copy full SHA for 732071b

• push current updated

  ArthurZucker

  committed
  3a15b4e

  Copy full SHA for 3a15b4e

• working mult images!

  ArthurZucker

  committed
  b773bde

  Copy full SHA for b773bde

• add a small integration test

  ArthurZucker

  committed
  6c58167

  Copy full SHA for 6c58167

• Uodate configuration docstring

  amyeroberts

  committed
  c4c32fb

  Copy full SHA for c4c32fb

• Formatting

  amyeroberts

  committed
  9c621af

  Copy full SHA for 9c621af

• Config docstring fix

  amyeroberts

  committed
  172b5bc

  Copy full SHA for 172b5bc

• simplify model test

  ArthurZucker

  committed
  d34bac0

  Copy full SHA for d34bac0

• Merge branch 'add-pixtral' of github.com:huggingface/transformers into add-pixtral

  ArthurZucker

  committed
  ed74135

  Copy full SHA for ed74135

• fixup modeling and etests

  ArthurZucker

  committed
  e090756

  Copy full SHA for e090756

• Return BatchMixFeature in image processor

  amyeroberts

  committed
  3725e23

  Copy full SHA for 3725e23

• fix some copies

  ArthurZucker

  committed
  26adfec

  Copy full SHA for 26adfec

• Merge branch 'add-pixtral' of github.com:huggingface/transformers into add-pixtral

  ArthurZucker

  committed
  4a65050

  Copy full SHA for 4a65050

• update

  ArthurZucker

  committed
  4ee5cfb

  Copy full SHA for 4ee5cfb

• nits

  ArthurZucker

  committed
  66de967

  Copy full SHA for 66de967

• Update model docstring

  amyeroberts

  committed
  07c7600

  Copy full SHA for 07c7600

• Apply suggestions from code review

  amyeroberts

  authored
  ff04e9f

  Copy full SHA for ff04e9f

• Fix up

  amyeroberts

  committed
  e7fae23

  Copy full SHA for e7fae23

• updates

  ArthurZucker

  committed
  324ba36

  Copy full SHA for 324ba36

• revert modeling changes

  ArthurZucker

  committed
  c4ad4e5

  Copy full SHA for c4ad4e5

• update

  ArthurZucker

  committed
  9f2d98b

  Copy full SHA for 9f2d98b

• Merge branch 'add-pixtral' of github.com:huggingface/transformers into add-pixtral

  ArthurZucker

  committed
  4562fa4

  Copy full SHA for 4562fa4

• update

  ArthurZucker

  committed
  97b4d93

  Copy full SHA for 97b4d93

• fix load safe

  ArthurZucker

  committed
  ce23dc3

  Copy full SHA for ce23dc3

• addd liscence

  ArthurZucker

  committed
  bbf516c

  Copy full SHA for bbf516c

• update

  ArthurZucker

  committed
  b783e7a

  Copy full SHA for b783e7a

• use pixel_values as required by the model

  ArthurZucker

  committed
  443917f

  Copy full SHA for 443917f

• skip some tests and refactor

  ArthurZucker

  committed
  f9291ea

  Copy full SHA for f9291ea

• Add pixtral image processing tests (#33476)

  Show description for db84a7d
  amyeroberts

  authored
  db84a7d

  Copy full SHA for db84a7d

• fixup post merge

  ArthurZucker

  committed
  908233f

  Copy full SHA for 908233f

• images -> pixel values

  ArthurZucker

  committed
  8c0f8f6

  Copy full SHA for 8c0f8f6

• oups sorry Mr docbuilder

  ArthurZucker

  committed
  b7d7760

  Copy full SHA for b7d7760

• isort

  ArthurZucker

  committed
  be154e1

  Copy full SHA for be154e1

• fix

  ArthurZucker

  committed
  bd721e2

  Copy full SHA for bd721e2

• fix processor tests

  ArthurZucker

  committed
  2eda353

  Copy full SHA for 2eda353

• small fixes

  ArthurZucker

  committed
  36e5525

  Copy full SHA for 36e5525

• nit

  ArthurZucker

  committed
  7d4bb19

  Copy full SHA for 7d4bb19

• update

  ArthurZucker

  committed
  df84fe7

  Copy full SHA for df84fe7

• last nits

  ArthurZucker

  committed
  0da8b22

  Copy full SHA for 0da8b22

• oups this was really breaking!

  ArthurZucker

  committed
  8cfff1a

  Copy full SHA for 8cfff1a

• nits

  ArthurZucker

  committed
  1effab2

  Copy full SHA for 1effab2

Commits on Sep 14, 2024

• is composition needs to be true

  ArthurZucker

  committed
  f33fe19

  Copy full SHA for f33fe19