Skip to content

Tokenizer 1.18.5
Compare
Choose a tag to compare
@guillaumekln guillaumekln released this 07 Jul 10:39
· 238 commits to master since this release
v1.18.5
8691c62

Fixes and improvements

  • Fix possible crash when applying a case insensitive BPE model on Unicode characters
Assets 2
Loading