Skip to content

Commit e369fe6

Browse files
marksturAndrew Lapp
authored and
Andrew Lapp
committed
Update README.md to clarify model requirement (huggingface#1315)
Clarify that language models must be transformers models for text. This is a bit redundant with intro description, but attempts to better address a question that that comes up (issue 1257). Closes: huggingface#1257
1 parent bb7af1f commit e369fe6

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

README.md

+1-1
Original file line numberDiff line numberDiff line change
@@ -168,7 +168,7 @@ train_stats = ppo_trainer.step([query_tensor[0]], [response_tensor[0]], reward)
168168
The PPO implementation largely follows the structure introduced in the paper **"Fine-Tuning Language Models from Human Preferences"** by D. Ziegler et al. \[[paper](https://arxiv.org/pdf/1909.08593.pdf), [code](https://github.com/openai/lm-human-preferences)].
169169

170170
### Language models
171-
The language models utilize the `transformers` library by 🤗 Hugging Face.
171+
The language models utilize the `transformers` library by 🤗 Hugging Face. Currently, `trl` only supports `transformers` models **for text**.
172172

173173
## Citation
174174

0 commit comments

Comments
 (0)