From da6ba881a161bac76a3238390853addad6813eef Mon Sep 17 00:00:00 2001 From: Libin Tang Date: Sun, 21 Jan 2024 11:28:36 -0800 Subject: [PATCH 1/2] Add DPO of TRL in README.md --- README.md | 10 ++++++++++ 1 file changed, 10 insertions(+) diff --git a/README.md b/README.md index 66baa8c28b..880690ea43 100644 --- a/README.md +++ b/README.md @@ -190,6 +190,16 @@ The following model architectures, tasks and device distributions have been vali +- TRL: + +
+ +| Architecture | Training | Inference | Tasks | +|------------------|:--------:|:--------------------:|:-----:| +| LLAMA2 | |
  • Multi cards
    • |
  • [DPO Pipeline](https://github.com/huggingface/optimum-habana/tree/main/examples/trl)
    • | + +
    + Other models and tasks supported by the 🤗 Transformers and 🤗 Diffusers library may also work. You can refer to this [section](https://github.com/huggingface/optimum-habana#how-to-use-it) for using them with 🤗 Optimum Habana. Besides, [this page](https://github.com/huggingface/optimum-habana/tree/main/examples) explains how to modify any [example](https://github.com/huggingface/transformers/tree/main/examples/pytorch) from the 🤗 Transformers library to make it work with 🤗 Optimum Habana. If you find any issues while using those, please open an issue or a pull request. From c82a163571e6f3470c985f66cbceb5bab7db4e2b Mon Sep 17 00:00:00 2001 From: regisss <15324346+regisss@users.noreply.github.com> Date: Mon, 22 Jan 2024 22:54:57 +0100 Subject: [PATCH 2/2] Refinements --- README.md | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/README.md b/README.md index 880690ea43..c95afede1c 100644 --- a/README.md +++ b/README.md @@ -185,8 +185,8 @@ The following model architectures, tasks and device distributions have been vali | Architecture | Training | Inference | Tasks | |------------------|:--------:|:--------------------:|:-----:| -| Stable Diffusion | |
  • Single card
    • |
  • [text-to-image generation](https://github.com/huggingface/optimum-habana/tree/main/examples/stable-diffusion)
    • | -| LDM3D | |
  • Single card
    • |
  • [text-to-image generation](https://github.com/huggingface/optimum-habana/tree/main/examples/stable-diffusion)
    • | +| Stable Diffusion | |
  • Single card
    • |
  • [text-to-image generation](https://github.com/huggingface/optimum-habana/tree/main/examples/stable-diffusion)
    • | +| LDM3D | |
  • Single card
    • |
  • [text-to-image generation](https://github.com/huggingface/optimum-habana/tree/main/examples/stable-diffusion)
    • | @@ -196,7 +196,7 @@ The following model architectures, tasks and device distributions have been vali | Architecture | Training | Inference | Tasks | |------------------|:--------:|:--------------------:|:-----:| -| LLAMA2 | |
  • Multi cards
    • |
  • [DPO Pipeline](https://github.com/huggingface/optimum-habana/tree/main/examples/trl)
    • | +| Llama 2 | |
  • Multi card
    • |
  • [DPO Pipeline](https://github.com/huggingface/optimum-habana/tree/main/examples/trl)
    • |