convert_llama_weights_to_hf

[JosephChenHub]

is there a script to convert weights to hf format?

[rupeshs]

@JosephChenHub Are you looking for this https://huggingface.co/meta-llama/Meta-Llama-3-8B

[bkhanal-11]

@JosephChenHub you can use the script convert_llama_weights_to_hf.py. Also some instructions from llama-recipe:

## Install Hugging Face Transformers from source
pip freeze | grep transformers ## verify it is version 4.31.0 or higher

git clone git@github.com:huggingface/transformers.git
cd transformers
pip install protobuf
python src/transformers/models/llama/convert_llama_weights_to_hf.py \
   --input_dir /path/to/downloaded/llama/weights --model_size 7B --output_dir /output/path

This is not updated for llama3, but you can give it a go.

[ArthurZucker]

huggingface/transformers#30334 will add the script and everything you need

[jspisak]

thanks @ArthurZucker! Closing this out as it's solved..