Code

Add Video Llava #29733

Code

Merged

zucchini-nlp merged 57 commits intohuggingface:mainhuggingface/transformers:mainfrom zucchini-nlp:video_llavazucchini-nlp/transformers:video_llavaCopy head branch name to clipboardMay 15, 2024

+2,637-3

Commits

Commits on Mar 19, 2024

• add model draft

  zucchini-nlp

  committed
  dce6678

  Copy full SHA for dce6678

Commits on Mar 20, 2024

• update docstring

  zucchini-nlp

  committed
  72626df

  Copy full SHA for 72626df

• add tests

  zucchini-nlp

  committed
  8cca731

  Copy full SHA for 8cca731

• support image and video as input

  zucchini-nlp

  committed
  4ea4f70

  Copy full SHA for 4ea4f70

Commits on Mar 21, 2024

• update for better handling of mixed input and clean-up a bit

  zucchini-nlp

  committed
  c36819d

  Copy full SHA for c36819d

Commits on Apr 8, 2024

• bug when mixed inputs & add tests

  zucchini-nlp

  committed
  c1a8fd5

  Copy full SHA for c1a8fd5

• Update README.md

  Show description for c591c75
  

  zucchini-nlp

  and

  NielsRogge

  authored
  c591c75

  Copy full SHA for c591c75

• Merge remote-tracking branch 'upstream/main' into video_llava

  zucchini-nlp

  committed
  5ff8d18

  Copy full SHA for 5ff8d18

• link to abstract of paper in README

  zucchini-nlp

  committed
  a6bc68d

  Copy full SHA for a6bc68d

• fix test

  zucchini-nlp

  committed
  eb309ed

  Copy full SHA for eb309ed

• fix-copies

  zucchini-nlp

  committed
  2f46f6c

  Copy full SHA for 2f46f6c

• Merge branch 'main' into video_llava

  zucchini-nlp

  authored
  6b51b7e

  Copy full SHA for 6b51b7e

• make tests happy

  zucchini-nlp

  committed
  e112958

  Copy full SHA for e112958

Commits on Apr 10, 2024

• skip docstest for now

  zucchini-nlp

  committed
  5cb6163

  Copy full SHA for 5cb6163

Commits on Apr 18, 2024

• do not run doctest for now

  zucchini-nlp

  committed
  930147d

  Copy full SHA for 930147d

• Merge remote-tracking branch 'upstream/main' into video_llava

  zucchini-nlp

  committed
  24ec2b3

  Copy full SHA for 24ec2b3

Commits on Apr 22, 2024

• Update src/transformers/models/video_llava/processing_video_llava.py

  Show description for 142bfc0
  

  zucchini-nlp

  and

  amyeroberts

  authored
  142bfc0

  Copy full SHA for 142bfc0

• Update src/transformers/models/video_llava/image_processing_video_llava.py

  Show description for fdec895
  

  zucchini-nlp

  and

  amyeroberts

  authored
  fdec895

  Copy full SHA for fdec895

• Update src/transformers/models/video_llava/image_processing_video_llava.py

  Show description for e83251c
  

  zucchini-nlp

  and

  amyeroberts

  authored
  e83251c

  Copy full SHA for e83251c

• Update src/transformers/models/video_llava/image_processing_video_llava.py

  Show description for 4fcfe72
  

  zucchini-nlp

  and

  amyeroberts

  authored
  4fcfe72

  Copy full SHA for 4fcfe72

• Update src/transformers/models/video_llava/image_processing_video_llava.py

  Show description for 327030d
  

  zucchini-nlp

  and

  amyeroberts

  authored
  327030d

  Copy full SHA for 327030d

• Update tests/models/video_llava/test_modeling_video_llava.py

  Show description for 33289a5
  

  zucchini-nlp

  and

  amyeroberts

  authored
  33289a5

  Copy full SHA for 33289a5

• Update src/transformers/models/video_llava/image_processing_video_llava.py

  Show description for dfef75a
  

  zucchini-nlp

  and

  amyeroberts

  authored
  dfef75a

  Copy full SHA for dfef75a

• address review comments

  zucchini-nlp

  committed
  ebf1042

  Copy full SHA for ebf1042

• failing tests

  zucchini-nlp

  committed
  aa1b278

  Copy full SHA for aa1b278

Commits on Apr 23, 2024

• Fix vocab_size in common tests for VLMs

  zucchini-nlp

  committed
  7802922

  Copy full SHA for 7802922

• codestyle

  zucchini-nlp

  committed
  9fce414

  Copy full SHA for 9fce414

• Merge branch 'huggingface:main' into video_llava

  zucchini-nlp

  authored
  e8b4569

  Copy full SHA for e8b4569

Commits on Apr 29, 2024

• Update src/transformers/models/video_llava/configuration_video_llava.py

  Show description for bb1cc26
  

  zucchini-nlp

  and

  amyeroberts

  authored
  bb1cc26

  Copy full SHA for bb1cc26

• Update src/transformers/models/video_llava/configuration_video_llava.py

  Show description for e2e92b2
  

  zucchini-nlp

  and

  amyeroberts

  authored
  e2e92b2

  Copy full SHA for e2e92b2

• Update src/transformers/models/video_llava/modeling_video_llava.py

  Show description for 5c77fff
  

  zucchini-nlp

  and

  amyeroberts

  authored
  5c77fff

  Copy full SHA for 5c77fff

• Update src/transformers/models/video_llava/modeling_video_llava.py

  Show description for 99518cb
  

  zucchini-nlp

  and

  amyeroberts

  authored
  99518cb

  Copy full SHA for 99518cb

Commits on Apr 30, 2024

• Update docs/source/en/model_doc/video_llava.md

  Show description for 451fd72
  

  zucchini-nlp

  and

  amyeroberts

  authored
  451fd72

  Copy full SHA for 451fd72

• Update docs/source/en/model_doc/video_llava.md

  Show description for 95a9a01
  

  zucchini-nlp

  and

  amyeroberts

  authored
  95a9a01

  Copy full SHA for 95a9a01

• Update src/transformers/models/video_llava/image_processing_video_llava.py

  Show description for 347fa8c
  

  zucchini-nlp

  and

  amyeroberts

  authored
  347fa8c

  Copy full SHA for 347fa8c

• Update docs/source/en/model_doc/video_llava.md

  Show description for 3e2f1b4
  

  zucchini-nlp

  and

  amyeroberts

  authored
  3e2f1b4

  Copy full SHA for 3e2f1b4

• Update src/transformers/models/video_llava/processing_video_llava.py

  Show description for 3cd1222
  

  zucchini-nlp

  and

  amyeroberts

  authored
  3cd1222

  Copy full SHA for 3cd1222

• Update tests/models/video_llava/test_modeling_video_llava.py

  Show description for 242703a
  

  zucchini-nlp

  and

  amyeroberts

  authored
  242703a

  Copy full SHA for 242703a

• Update tests/models/video_llava/test_modeling_video_llava.py

  Show description for 9c1a10d
  

  zucchini-nlp

  and

  amyeroberts

  authored
  9c1a10d

  Copy full SHA for 9c1a10d

• Update tests/models/video_llava/test_modeling_video_llava.py

  Show description for b4145e1
  

  zucchini-nlp

  and

  amyeroberts

  authored
  b4145e1

  Copy full SHA for b4145e1

• PR suggestions

  zucchini-nlp

  committed
  5803d5a

  Copy full SHA for 5803d5a

• fix-copies

  zucchini-nlp

  committed
  975d959

  Copy full SHA for 975d959

• Merge branch 'main' into video_llava

  zucchini-nlp

  authored
  7f30e3b

  Copy full SHA for 7f30e3b

Commits on May 1, 2024

• Merge branch 'huggingface:main' into video_llava

  zucchini-nlp

  authored
  6bdad81

  Copy full SHA for 6bdad81

Commits on May 8, 2024

• Update src/transformers/models/video_llava/configuration_video_llava.py

  Show description for a817f31
  

  zucchini-nlp

  and

  amyeroberts

  authored
  a817f31

  Copy full SHA for a817f31

• Update src/transformers/models/video_llava/configuration_video_llava.py

  Show description for dba80e2
  

  zucchini-nlp

  and

  amyeroberts

  authored
  dba80e2

  Copy full SHA for dba80e2

• Merge remote-tracking branch 'upstream/main' into video_llava

  zucchini-nlp

  committed
  6b3eafb

  Copy full SHA for 6b3eafb

• add full example in docs

  zucchini-nlp

  committed
  ba4e125

  Copy full SHA for ba4e125

Commits on May 10, 2024

• clean-up with new model-id

  zucchini-nlp

  committed
  6cc8af1

  Copy full SHA for 6cc8af1

• [run-slow] video_llava

  zucchini-nlp

  committed
  885a5ae

  Copy full SHA for 885a5ae

• update docstring

  zucchini-nlp

  committed
  377aafe

  Copy full SHA for 377aafe

• Merge branch 'main' into video_llava

  zucchini-nlp

  authored
  637b197

  Copy full SHA for 637b197

• [run-slow] video_llava

  zucchini-nlp

  committed
  a411347

  Copy full SHA for a411347

Commits on May 14, 2024

• Merge branch 'huggingface:main' into video_llava

  zucchini-nlp

  authored
  0d83eaf

  Copy full SHA for 0d83eaf

Commits on May 15, 2024

• remove all achive maps

  zucchini-nlp

  committed
  8134039

  Copy full SHA for 8134039

• fix some tests

  zucchini-nlp

  committed
  8e15514

  Copy full SHA for 8e15514

• test was supposed to be skipped for llava :)

  zucchini-nlp

  committed
  5d1e976

  Copy full SHA for 5d1e976