Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
libinta authored Dec 7, 2024
1 parent 5e4f119 commit d236615
Showing 1 changed file with 0 additions and 8 deletions.
8 changes: 0 additions & 8 deletions examples/question-answering/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -190,14 +190,6 @@ Here is a DeepSpeed configuration you can use to train your models on Gaudi:
}
```


### Training in torch.compile mode

Albert XXL model training in [torch.compile](pytorch.org/tutorials/intermediate/torch_compile_tutorial.html) mode is enabled by applying the following changes to your command, \
a) Set the following environment variables `PT_HPU_LAZY_MODE=0` and `PT_ENABLE_INT64_SUPPORT=1`. \
b) Run the above commands with `--model_name_or_path albert-xxlarge-v1`, `--use_lazy_mode False` and add `--torch_compile`, `--torch_compile_backend hpu_backend` and remove `--use_hpu_graphs_for_inference` flags.


## Fine-tuning Llama on SQuAD1.1

> [!NOTE]
Expand Down

0 comments on commit d236615

Please sign in to comment.