Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[llama-3.1] Bump transformers version #2243

Merged
merged 2 commits into from
Jul 25, 2024
Merged

[llama-3.1] Bump transformers version #2243

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
5a5cef0
[llama-3.1] Bump transformers version
pcuenca Jul 25, 2024
5e3b8c2
Update llama31.md
pcuenca Jul 25, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 3 additions & 3 deletions llama31.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -518,10 +518,10 @@ _Note: We are currently evaluating Llama 3.1 individually on the new [Open LLM L

## Using Hugging Face Transformers

Llama 3.1 requires a minor modeling update to handle RoPE scaling effectively. With Transformers [release 4.43](https://github.com/huggingface/transformers/tags), you can use the new Llama 3.1 models and leverage all the tools within the Hugging Face ecosystem. Make sure to use the latest `transformers` release:
Llama 3.1 requires a minor modeling update to handle RoPE scaling effectively. With Transformers [release 4.43.2](https://github.com/huggingface/transformers/releases/tag/v4.43.2), you can use the new Llama 3.1 models and leverage all the tools within the Hugging Face ecosystem. Make sure to use the latest `transformers` release:

```bash
pip install "transformers>=4.43" --upgrade
pip install "transformers>=4.43.2" --upgrade
```

A couple of details:
Expand Down Expand Up @@ -814,7 +814,7 @@ In this section, we’ll look at the tools available in the Hugging Face ecosyst
First, install the nightly version of 🤗 TRL and clone the repo to access the [training script](https://github.com/huggingface/trl/blob/main/examples/scripts/sft.py):

```
pip install "transformers>=4.43" --upgrade
pip install "transformers>=4.43.2" --upgrade
pip install --upgrade bitsandbytes
pip install --ugprade peft
pip install git+https://github.com/huggingface/trl
Expand Down