(Willing to PR) Make tokenizer.padding_side
an argument instead of only being a field
#30447
Labels
Core: Tokenization
Internals of the library; Tokenization.
Feature request
Request for a new feature
Feature request
Hi thanks for the library! When using tokenizer, for example, for batch-generation with GPT2 (in https://discuss.huggingface.co/t/batch-generation-with-gpt2/1517), it seems that currently I have to do something like:
Therefore, it would be great to have:
just like what we do today for many options like
padding_strategy
etc.Motivation
(see above)
Your contribution
Yes, I am willing to PR
The text was updated successfully, but these errors were encountered: