Skip to content

Commit

Permalink
use auto dtype by default
Browse files Browse the repository at this point in the history
  • Loading branch information
gante committed Jan 22, 2025
1 parent 8bdd489 commit 75f8615
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion src/transformers/commands/chat.py
Original file line number Diff line number Diff line change
Expand Up @@ -380,7 +380,7 @@ class ChatArguments:
metadata={"help": "Specific model version to use (can be a branch name, tag name or commit id)."},
)
torch_dtype: Optional[str] = field(
default=None,
default="auto",
metadata={
"help": "Override the default `torch.dtype` and load the model under this dtype. If `'auto'` is passed, "
"the dtype will be automatically derived from the model's weights.",
Expand Down

0 comments on commit 75f8615

Please sign in to comment.