-
Notifications
You must be signed in to change notification settings - Fork 28.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Adding Llava to transformers #25789
Closed
+3,659
−993
Closed
Adding Llava to transformers #25789
Changes from 99 commits
Commits
Show all changes
107 commits
Select commit
Hold shift + click to select a range
2d77eb4
initial
shauray8 d2fad3e
some some
shauray8 13a06c0
cannot use image processor
shauray8 284a994
processor
shauray8 1efdea8
more arch
shauray8 eed85d4
llava
shauray8 4114615
testing colab
shauray8 a98d49c
shape
shauray8 fbf041a
replace
shauray8 530059e
on hf repo
shauray8 1262761
might work
shauray8 b0aa991
almost there
shauray8 79ffdcc
almost
shauray8 332ca52
docs
shauray8 67ca520
tests
shauray8 ae9b107
tests and docs
shauray8 753c536
testing
shauray8 279bac3
making tests work
shauray8 0248581
make
shauray8 63b1ee2
still testing
shauray8 b024d94
done
shauray8 be77707
more
shauray8 30f88a5
make
shauray8 bba52b9
Merge branch 'main' into llava
shauray8 825a5b5
more tests
shauray8 9b80ba4
more tests
shauray8 8756754
adding to imports
shauray8 38a21c0
more
shauray8 51f1cd4
ff
shauray8 db402ac
fixup
shauray8 44b3dad
llava
shauray8 30b131f
Merge branch 'main' into llava
shauray8 382e67c
should look green now
shauray8 9ad53fe
config
shauray8 de05fd5
potential fix
shauray8 7933073
maybe
shauray8 21e50ff
fix
shauray8 9c57b0b
more fixes
shauray8 ad42ef4
greeen
shauray8 51327e5
more green
shauray8 2545d96
add 13B
shauray8 7c21c34
Merge branch 'main' into llava
shauray8 e0481ce
Merge branch 'llava' of https://github.com/shauray8/transformers into…
shauray8 a05c0b3
fixup
shauray8 fa1ff96
check
shauray8 58307cb
Merge branch 'main' into llava
shauray8 c7fed6f
fixup
shauray8 a23bfff
Revert "more green"
shauray8 030b849
Revert "fixup"
shauray8 eb10dcc
figuring out
shauray8 7ed45eb
.
shauray8 42a4ff0
greeen
shauray8 c5307ed
maybe
shauray8 479c121
testing
shauray8 a377a20
.
shauray8 e379985
change
shauray8 4baba5a
.
shauray8 f61526e
require fix
shauray8 98095a2
Merge branch 'main' into llava
shauray8 414460c
require fix
shauray8 217baf7
Merge branch 'llava' of https://github.com/shauray8/transformers into…
shauray8 8e151f6
modeling changes
shauray8 f157d54
to torhc
shauray8 cbb35f3
doctested
shauray8 cdbeb6a
attention bias
shauray8 9b1f5ea
Merge branch 'main' into llava
shauray8 0de73c0
Revert "doctested"
shauray8 af46591
revert
shauray8 95a84a0
attention config
shauray8 21b05df
doctest
shauray8 1b6e103
@1pass
shauray8 382ffb3
dummy
shauray8 853f133
reviews
shauray8 6c250c9
docs
shauray8 3cd047c
review
shauray8 f2503e0
pull
shauray8 82b6450
doctests
shauray8 27ba812
arch changes
shauray8 c62d7e9
v1.5
shauray8 b13dd22
fixp
shauray8 27610b8
1.5
shauray8 a7bd1b6
llavatext
shauray8 1d749c4
llavaTEXT
shauray8 8f6d172
minor
shauray8 c8eb6eb
text config vision config
shauray8 aad4ebd
docs
shauray8 aa93963
fix
shauray8 61e48d5
testing
shauray8 60fef6d
llava1.5
shauray8 9dbcbe9
Merge branch 'main' into llava
shauray8 8d1fa60
works with both
shauray8 1282b45
fixup
shauray8 c05d1dc
update
shauray8 b924b10
update
shauray8 c9ff3a8
clip model
shauray8 d8d9038
fix
shauray8 579c6a4
1.5
shauray8 a9d4cf7
test hub
shauray8 d79484a
better results
shauray8 f52d10a
clip model integration, ditching llama
shauray8 9485c6f
convert
shauray8 8cad3e5
converting 3rd
shauray8 e1943a4
weights converted
shauray8 a78db23
Merge branch 'main' into llava
shauray8 471a222
merge
shauray8 4a6bbc7
Merge branch 'llava' of https://github.com/shauray8/transformers into…
shauray8 b62315d
fixing modeling and documentation
shauray8 File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
make sure to run
make fix-copies
after this to update the other READMEs