Support for local instances of llama 3 and changes to support reusing trie and homomorphism#74

Merged

Saibo-creator merged 6 commits intoepfl-dlab:mainfrom MatthewChang:llama3-local

Aug 27, 2024

+20-11

Commits on Jul 10, 2024

check for llama 3 name anywhere in path
A Meta HPC user for matthewchang
committed

Commits on Jul 22, 2024

add function for grammar switching
A Meta HPC user for matthewchang
committed

Commits on Jul 23, 2024

add support for resuing trie
A Meta HPC user for matthewchang
committed
add support for reusing trie and homomorphism
A Meta HPC user for matthewchang
committed

Commits on Jul 26, 2024

add support for custom device to fix memory leak
A Meta HPC user for matthewchang
committed

Commits on Jul 30, 2024

clean up commits
A Meta HPC user for matthewchang
committed