-
Notifications
You must be signed in to change notification settings - Fork 27.8k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add BROS #23190
Merged
Merged
Add BROS #23190
Changes from 112 commits
Commits
Show all changes
120 commits
Select commit
Hold shift + click to select a range
3db764f
add Bros boilerplate
jinhopark8345 2dc368a
copy and pasted modeling_bros.py from official Bros repo
jinhopark8345 5603061
update copyright of bros files
jinhopark8345 dbc56b8
copy tokenization_bros.py from official repo and update import path
jinhopark8345 e2a2d9d
copy tokenization_bros_fast.py from official repo and update import path
jinhopark8345 90ce711
copy configuration_bros.py from official repo and update import path
jinhopark8345 6126da1
remove trailing period in copyright line
jinhopark8345 63139eb
copy and paste bros/__init__.py from official repo
jinhopark8345 596d1a7
save formatting
jinhopark8345 764e8df
remove unused unnecessary pe_type argument - using only crel type
jinhopark8345 f35348f
resolve import issue
jinhopark8345 892dd2d
remove unused model classes
jinhopark8345 37c7d9f
remove unnecessary tests
jinhopark8345 d878de0
remove unused classes
jinhopark8345 772d20e
fix original code's bug - layer_module's argument order
jinhopark8345 6ef6ca7
clean up modeling auto
jinhopark8345 c338261
add bbox to prepare_config_and_inputs
jinhopark8345 7379457
set temporary value to hidden_size (32 is too low because of the of the
jinhopark8345 602e2d9
remove decoder test, update create_and_check* input arguemnts
jinhopark8345 79b886c
add missing variable to model tests
jinhopark8345 5f35f68
do make fixup
jinhopark8345 3eace5d
update bros.mdx
jinhopark8345 9f0e8ca
add boilerate plate for no_head inference test
jinhopark8345 66ff6ce
update BROS_PRETRAINED_MODEL_ARCHIVE_LIST (add naver-clova-ocr prefix)
jinhopark8345 f3e9dab
add prepare_bros_batch_inputs function
jinhopark8345 7022d4c
update modeling_common to add bbox inputs in Bros Model Test
jinhopark8345 f9aab55
remove unnecessary model inference
jinhopark8345 41e1ad9
add test case
jinhopark8345 94cf5fc
add model_doc
jinhopark8345 d10e166
add test case for token_classification
jinhopark8345 2845c23
apply fixup
jinhopark8345 55d5d7b
update modeling code
jinhopark8345 e41ab5d
update BrosForTokenClassification loss calculation logic
jinhopark8345 4ef71fd
revert logits preprocessing logic to make sure logits have original s…
jinhopark8345 d735bd5
- update class name
jinhopark8345 5ce570e
- add BrosSpadeOutput
jinhopark8345 4933093
add boilerate plate for no_head inference test
jinhopark8345 0d53a2d
add prepare_bros_batch_inputs function
jinhopark8345 7228d98
add test case
jinhopark8345 9e758d7
add test case for token_classification
jinhopark8345 7be8d1d
update modeling code
jinhopark8345 ca9f5e8
update BrosForTokenClassification loss calculation logic
jinhopark8345 a6e77d7
revert logits preprocessing logic to make sure logits have original s…
jinhopark8345 13639d7
Merge remote-tracking branch 'upstream/main' into add-bros
jinhopark8345 725e145
apply masking on the fly
jinhopark8345 f5113b3
add BrosSpadeForTokenLinking
jinhopark8345 a955d3c
update class name
jinhopark8345 0cb524f
separate the logits calculation logic and loss calculation logic
jinhopark8345 5939860
update logic for loss calculation so that logits shape doesn't change
jinhopark8345 179c4f9
update typo
jinhopark8345 24d55f9
update prepare_config_and_inputs
jinhopark8345 aa28567
update dummy node initialization
jinhopark8345 d1a120f
update last_hidden_states getting logic to consider when return_dict …
jinhopark8345 ed5efb3
update box first token mask param
jinhopark8345 2d7bcc7
bugfix: remove random attention mask generation
jinhopark8345 8379565
update keys to ignore on load missing
jinhopark8345 632fde5
run make style and quality
jinhopark8345 1f2a956
apply make style and quality of other codes
jinhopark8345 d83b042
update box_first_token_mask to bool type
jinhopark8345 794dbba
update index.md
jinhopark8345 863155f
apply make style and quality
jinhopark8345 d18a5e6
Merge remote-tracking branch 'upstream/main' into add-bros
jinhopark8345 6f7c3d3
apply make fix-copies
jinhopark8345 eb7ba73
pass check_repo
jinhopark8345 16f4830
update bros model doc
jinhopark8345 ecce552
docstring bugfix fix
jinhopark8345 d927015
add checkpoint for doc, tokenizer for doc
jinhopark8345 46ec931
Update README.md
jinhopark8345 4433162
Update docs/source/en/model_doc/bros.md
jinhopark8345 828c9b0
Update bros.md
jinhopark8345 41de331
Update src/transformers/__init__.py
jinhopark8345 fa52d90
Update docs/source/en/model_doc/bros.md
jinhopark8345 d219760
Apply suggestions from code review
jinhopark8345 3b64b10
apply suggestions from code review
jinhopark8345 6811e44
apply suggestions from code review
jinhopark8345 8922ffa
revert test_processor_markuplm.py
jinhopark8345 09c3f82
Update test_processor_markuplm.py
jinhopark8345 a4d2e91
apply suggestions from code review
jinhopark8345 6bce6e1
apply suggestions from code review
jinhopark8345 0b3e750
apply suggestions from code review
jinhopark8345 a10fbac
update BrosSpadeELForTokenClassification head name to entity linker
jinhopark8345 336a94c
add doc string for config params
jinhopark8345 9da2fa4
update class, var names to more explicit and apply suggestions from c…
jinhopark8345 e2e304f
remove unnecessary keys to ignore
jinhopark8345 f621427
update relation extractor to be initialized with config
jinhopark8345 8a7d54c
add bros processor
jinhopark8345 fb7a991
apply make style and quality
jinhopark8345 9a47510
update bros.md
jinhopark8345 ab706c0
remove bros tokenizer, add bros processor that wraps bert tokenizer
jinhopark8345 5222230
revert change
jinhopark8345 3ef8bd5
apply make fix-copies
jinhopark8345 2a5a010
update processor code, update itc -> initial token, stc -> subsequent…
jinhopark8345 7761029
add type hint
jinhopark8345 e9449d1
remove unnecessary condition branches in embedding forward
jinhopark8345 b001e88
Merge remote-tracking branch 'upstream/main' into add-bros
jinhopark8345 6a22091
fix auto tokenizer fail
jinhopark8345 c16e4d8
update docstring for each classes
jinhopark8345 66f1446
Merge remote-tracking branch 'upstream/main' into add-bros
jinhopark8345 3f07cb4
update bbox input dimension as standard 2 points and convert them to 4
jinhopark8345 20a2bee
update bros docs
jinhopark8345 14e5591
Merge remote-tracking branch 'upstream/main' into add-bros
jinhopark8345 52dcb38
apply suggestions from code review : update Bros -> BROS in bros.md
jinhopark8345 6cdcaf2
1. box prefix var -> bbox
jinhopark8345 983ac62
replace einsum with torch matmul
jinhopark8345 007333a
apply style and quality
jinhopark8345 a51a66d
remove unused argument
jinhopark8345 0403675
remove unused arguments
jinhopark8345 e15b019
update docstrings
jinhopark8345 2b6a8f4
apply suggestions from code review: add BrosBboxEmbeddings, replace
jinhopark8345 039afcb
Merge remote-tracking branch 'upstream/main' into add-bros
jinhopark8345 0fb70f1
Merge remote-tracking branch 'upstream/main' into add-bros
jinhopark8345 1a8558b
revert einsum update
jinhopark8345 8eb78e1
update bros processor
jinhopark8345 44a0fc9
apply suggestions from code review
jinhopark8345 19993a7
add conversion script for bros
jinhopark8345 8fe9f5a
Apply suggestions from code review
jinhopark8345 e1d0c73
Merge remote-tracking branch 'upstream/main' into add-bros
jinhopark8345 9e883fb
fix readme
jinhopark8345 8223fed
apply fix-copies
jinhopark8345 187c411
Merge remote-tracking branch 'upstream/main' into add-bros
jinhopark8345 File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Applied suggestions from code review!