Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SAMPLE] Add a translation sample with a non LLM model #278

Open
nmetulev opened this issue Mar 6, 2025 · 0 comments
Open

[SAMPLE] Add a translation sample with a non LLM model #278

nmetulev opened this issue Mar 6, 2025 · 0 comments

Comments

@nmetulev
Copy link
Member

nmetulev commented Mar 6, 2025

Is this a sample for an existing model or API, or for a new model? (If a new model, provide a link to the model in ONNX format)
Yes, for example https://huggingface.co/models?library=onnx&sort=trending&search=OPUS+MT

Describe the scenarios(s)
Using an LLM for translation is an overkill and can be slow for large prompts. We should have a sample that shows how to do translation with a model intended for translation.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant