Skip to content

Release v3.0b2

Latest
Latest
Compare
Choose a tag to compare
@hiroshi-matsuda-rit hiroshi-matsuda-rit released this 07 Aug 04:20
v3.0b2
c693f9d
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.
  • Update for Hugging Face Tokenizer
    • Following Llama tokenizer's manner, add BOS instead of EOD
  • No changes for SentencePiece model
Assets 2
Loading