Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
hsubramony authored Feb 26, 2025
1 parent 1d83302 commit 1ffc701
Showing 1 changed file with 5 additions and 1 deletion.
6 changes: 5 additions & 1 deletion examples/text-generation/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -845,8 +845,12 @@ pip install -r requirements_lm_eval.txt
```

> [!NOTE]
> Please add the flags COMPLEXGUID_DISABLE_RMS_NORM=true and ENABLE_EXPERIMENTAL_FLAGS=true for models llama-70b[bf16]/llama-70b[PTQ fp8]/Llama-3.1-70B[fp8] accuracy issues when using lm_eval on gaudi2. Please note this is a workaround for 1.20 release only.
> Please add the flags for following models to improve accuracy when using lm_eval on gaudi2. Please note this is a workaround for 1.20 release only.
>
> ENABLE_LB_BUNDLE_ALL_COMPUTE_MME=0 COMPLEXGUID_DISABLE_RMS_NORM=true ENABLE_EXPERIMENTAL_FLAGS=true for llama-2-70b-hf[PTQ fp8]
>
> COMPLEXGUID_DISABLE_RMS_NORM=true ENABLE_EXPERIMENTAL_FLAGS=true for Llama-3.1-70B-Instruct[PTQ fp8] and llama-2-70b-hf[bf16]
>
> If custom models on hub is being used, please set env variable HF_DATASETS_TRUST_REMOTE_CODE=true instead of arg --trust_remote_code with the installed lm_eval version and dependency datasets==2.21.0

Expand Down

0 comments on commit 1ffc701

Please sign in to comment.