Metrics for language modeling #31
dennymarcels
started this conversation in
General
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hey guys, amazing work, I am already using this model in a project of mine!
Question: what were the mask_lm_accuracy and next_sentence_accuracy of BERTimbau trained in the corpora? I am using your small model as a base for pre-training domain-specific language and would like to compare those values.
Thank you.
Beta Was this translation helpful? Give feedback.
All reactions