Code

Adding Llava to transformers#25789

Code

Closed

shauray8 wants to merge 107 commits intohuggingface:mainhuggingface/transformers:mainfrom shauray8:llavaCopy head branch name to clipboard

+3,659-993

Commits

Commits on Aug 27, 2023

• initial

  shauray8

  committed
  2d77eb4

  Copy full SHA for 2d77eb4

Commits on Aug 28, 2023

• some some

  shauray8

  committed
  d2fad3e

  Copy full SHA for d2fad3e

• cannot use image processor

  shauray8

  committed
  13a06c0

  Copy full SHA for 13a06c0

• processor

  shauray8

  committed
  284a994

  Copy full SHA for 284a994

Commits on Aug 29, 2023

• more arch

  shauray8

  committed
  1efdea8

  Copy full SHA for 1efdea8

• llava

  shauray8

  committed
  eed85d4

  Copy full SHA for eed85d4

• testing colab

  shauray8

  committed
  4114615

  Copy full SHA for 4114615

• shape

  shauray8

  committed
  a98d49c

  Copy full SHA for a98d49c

Commits on Aug 30, 2023

• replace

  shauray8

  committed
  fbf041a

  Copy full SHA for fbf041a

Commits on Sep 2, 2023

• on hf repo

  shauray8

  committed
  530059e

  Copy full SHA for 530059e

• might work

  shauray8

  committed
  1262761

  Copy full SHA for 1262761

Commits on Sep 5, 2023

• almost there

  shauray8

  committed
  b0aa991

  Copy full SHA for b0aa991

Commits on Sep 6, 2023

• almost

  shauray8

  committed
  79ffdcc

  Copy full SHA for 79ffdcc

Commits on Sep 7, 2023

• docs

  shauray8

  committed
  332ca52

  Copy full SHA for 332ca52

• tests

  shauray8

  committed
  67ca520

  Copy full SHA for 67ca520

• tests and docs

  shauray8

  committed
  ae9b107

  Copy full SHA for ae9b107

• testing

  shauray8

  committed
  753c536

  Copy full SHA for 753c536

• making tests work

  shauray8

  committed
  279bac3

  Copy full SHA for 279bac3

• make

  shauray8

  committed
  0248581

  Copy full SHA for 0248581

Commits on Sep 11, 2023

• still testing

  shauray8

  committed
  63b1ee2

  Copy full SHA for 63b1ee2

• done

  shauray8

  committed
  b024d94

  Copy full SHA for b024d94

• more

  shauray8

  committed
  be77707

  Copy full SHA for be77707

• make

  shauray8

  committed
  30f88a5

  Copy full SHA for 30f88a5

• Merge branch 'main' into llava

  shauray8

  committed
  bba52b9

  Copy full SHA for bba52b9

• more tests

  shauray8

  committed
  825a5b5

  Copy full SHA for 825a5b5

• more tests

  shauray8

  committed
  9b80ba4

  Copy full SHA for 9b80ba4

• adding to imports

  shauray8

  committed
  8756754

  Copy full SHA for 8756754

Commits on Sep 12, 2023

• more

  shauray8

  committed
  38a21c0

  Copy full SHA for 38a21c0

• ff

  shauray8

  committed
  51f1cd4

  Copy full SHA for 51f1cd4

• fixup

  shauray8

  committed
  db402ac

  Copy full SHA for db402ac

• llava

  shauray8

  committed
  44b3dad

  Copy full SHA for 44b3dad

• Merge branch 'main' into llava

  shauray8

  authored
  30b131f

  Copy full SHA for 30b131f

• should look green now

  shauray8

  committed
  382e67c

  Copy full SHA for 382e67c

• config

  shauray8

  committed
  9ad53fe

  Copy full SHA for 9ad53fe

• potential fix

  shauray8

  committed
  de05fd5

  Copy full SHA for de05fd5

• maybe

  shauray8

  committed
  7933073

  Copy full SHA for 7933073

• fix

  shauray8

  committed
  21e50ff

  Copy full SHA for 21e50ff

Commits on Sep 13, 2023

• more fixes

  shauray8

  committed
  9c57b0b

  Copy full SHA for 9c57b0b

• greeen

  shauray8

  committed
  ad42ef4

  Copy full SHA for ad42ef4

• more green

  shauray8

  committed
  51327e5

  Copy full SHA for 51327e5

Commits on Sep 20, 2023

• add 13B

  shauray8

  committed
  2545d96

  Copy full SHA for 2545d96

• Merge branch 'main' into llava

  shauray8

  authored
  7c21c34

  Copy full SHA for 7c21c34

• Merge branch 'llava' of https://github.com/shauray8/transformers into llava

  shauray8

  committed
  e0481ce

  Copy full SHA for e0481ce

• fixup

  shauray8

  committed
  a05c0b3

  Copy full SHA for a05c0b3

• check

  shauray8

  committed
  fa1ff96

  Copy full SHA for fa1ff96

Commits on Sep 23, 2023

• Merge branch 'main' into llava

  shauray8

  committed
  58307cb

  Copy full SHA for 58307cb

• fixup

  shauray8

  committed
  c7fed6f

  Copy full SHA for c7fed6f

Commits on Sep 24, 2023

• Revert "more green"

  Show description for a23bfff
  shauray8

  committed
  a23bfff

  Copy full SHA for a23bfff

• Revert "fixup"

  Show description for 030b849
  shauray8

  committed
  030b849

  Copy full SHA for 030b849

• figuring out

  shauray8

  committed
  eb10dcc

  Copy full SHA for eb10dcc

• .

  shauray8

  committed
  7ed45eb

  Copy full SHA for 7ed45eb

• greeen

  shauray8

  committed
  42a4ff0

  Copy full SHA for 42a4ff0

• maybe

  shauray8

  committed
  c5307ed

  Copy full SHA for c5307ed

Commits on Sep 25, 2023

• testing

  shauray8

  committed
  479c121

  Copy full SHA for 479c121

• .

  shauray8

  committed
  a377a20

  Copy full SHA for a377a20

• change

  shauray8

  committed
  e379985

  Copy full SHA for e379985

• .

  shauray8

  committed
  4baba5a

  Copy full SHA for 4baba5a

Commits on Sep 28, 2023

• require fix

  shauray8

  committed
  f61526e

  Copy full SHA for f61526e

• Merge branch 'main' into llava

  shauray8

  authored
  98095a2

  Copy full SHA for 98095a2

• require fix

  shauray8

  committed
  414460c

  Copy full SHA for 414460c

• Merge branch 'llava' of https://github.com/shauray8/transformers into llava

  shauray8

  committed
  217baf7

  Copy full SHA for 217baf7

Commits on Sep 29, 2023

• modeling changes

  shauray8

  committed
  8e151f6

  Copy full SHA for 8e151f6

• to torhc

  shauray8

  committed
  f157d54

  Copy full SHA for f157d54

• doctested

  shauray8

  committed
  cbb35f3

  Copy full SHA for cbb35f3

• attention bias

  shauray8

  committed
  cdbeb6a

  Copy full SHA for cdbeb6a

• Merge branch 'main' into llava

  shauray8

  committed
  9b1f5ea

  Copy full SHA for 9b1f5ea

• Revert "doctested"

  Show description for 0de73c0
  shauray8

  committed
  0de73c0

  Copy full SHA for 0de73c0

• revert

  shauray8

  committed
  af46591

  Copy full SHA for af46591

• attention config

  shauray8

  committed
  95a84a0

  Copy full SHA for 95a84a0

• doctest

  shauray8

  committed
  21b05df

  Copy full SHA for 21b05df

Commits on Oct 6, 2023

• @1Pass

  shauray8

  committed
  1b6e103

  Copy full SHA for 1b6e103

• dummy

  shauray8

  committed
  382ffb3

  Copy full SHA for 382ffb3

• reviews

  shauray8

  committed
  853f133

  Copy full SHA for 853f133

• docs

  shauray8

  committed
  6c250c9

  Copy full SHA for 6c250c9

• review

  shauray8

  committed
  3cd047c

  Copy full SHA for 3cd047c

• pull

  shauray8

  committed
  f2503e0

  Copy full SHA for f2503e0

• doctests

  shauray8

  committed
  82b6450

  Copy full SHA for 82b6450

Commits on Oct 8, 2023

• arch changes

  shauray8

  committed
  27ba812

  Copy full SHA for 27ba812

• v1.5

  shauray8

  committed
  c62d7e9

  Copy full SHA for c62d7e9

• fixp

  shauray8

  committed
  b13dd22

  Copy full SHA for b13dd22

• 1.5

  shauray8

  committed
  27610b8

  Copy full SHA for 27610b8

• llavatext

  shauray8

  committed
  a7bd1b6

  Copy full SHA for a7bd1b6

• llavaTEXT

  shauray8

  committed
  1d749c4

  Copy full SHA for 1d749c4

• minor

  shauray8

  committed
  8f6d172

  Copy full SHA for 8f6d172

• text config vision config

  shauray8

  committed
  c8eb6eb

  Copy full SHA for c8eb6eb

Commits on Oct 9, 2023

• docs

  shauray8

  committed
  aad4ebd

  Copy full SHA for aad4ebd

• fix

  shauray8

  committed
  aa93963

  Copy full SHA for aa93963

• testing

  shauray8

  committed
  61e48d5

  Copy full SHA for 61e48d5

• llava1.5

  shauray8

  committed
  60fef6d

  Copy full SHA for 60fef6d

• Merge branch 'main' into llava

  shauray8

  authored
  9dbcbe9

  Copy full SHA for 9dbcbe9

• works with both

  shauray8

  committed
  8d1fa60

  Copy full SHA for 8d1fa60

• fixup

  shauray8

  committed
  1282b45

  Copy full SHA for 1282b45

Commits on Oct 10, 2023

• update

  shauray8

  committed
  c05d1dc

  Copy full SHA for c05d1dc

• update

  shauray8

  committed
  b924b10

  Copy full SHA for b924b10

• clip model

  shauray8

  committed
  c9ff3a8

  Copy full SHA for c9ff3a8

• fix

  shauray8

  committed
  d8d9038

  Copy full SHA for d8d9038

• 1.5

  shauray8

  committed
  579c6a4

  Copy full SHA for 579c6a4

• test hub

  shauray8

  committed
  a9d4cf7

  Copy full SHA for a9d4cf7

• better results

  shauray8

  committed
  d79484a

  Copy full SHA for d79484a

Commits on Oct 13, 2023

• clip model integration, ditching llama

  shauray8

  committed
  f52d10a

  Copy full SHA for f52d10a

• convert

  shauray8

  committed
  9485c6f

  Copy full SHA for 9485c6f

• converting 3rd

  shauray8

  committed
  8cad3e5

  Copy full SHA for 8cad3e5

Commits on Oct 30, 2023

• weights converted

  shauray8

  committed
  e1943a4

  Copy full SHA for e1943a4

Commits on Nov 6, 2023

• Merge branch 'main' into llava

  shauray8

  authored
  a78db23

  Copy full SHA for a78db23

• merge

  shauray8

  committed
  471a222

  Copy full SHA for 471a222

• Merge branch 'llava' of https://github.com/shauray8/transformers into llava

  shauray8

  committed
  4a6bbc7

  Copy full SHA for 4a6bbc7

Commits on Nov 10, 2023

• fixing modeling and documentation

  shauray8

  committed
  b62315d

  Copy full SHA for b62315d