Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Readme draft #930

Conversation

yury-gorbachev
Copy link
Contributor

Updates to describe:

  • latest changes in library with focus on GenAI api
  • expose more functionality that we have (continuous batching, speculative decoding, etc.)
  • provide lightweight samples as a beginning

pip install optimum[openvino]

# (Optional) Install (TBD) to be able to download models from Model Scope
#pip install optimum[openvino]
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

see https://pypi.org/project/modelscope/

Looks like we can recommend pip install modelscope with additional extras for NLP and other domains

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is good thing to have, but I am not sure if conversion will work as it is.
Proposal is to make this fix later when we will have document on modelscope support itself (this is being worked on right now)

@ilya-lavrenov ilya-lavrenov added this pull request to the merge queue Oct 9, 2024
Merged via the queue into openvinotoolkit:master with commit 5018f73 Oct 9, 2024
47 checks passed
ilya-lavrenov added a commit that referenced this pull request Oct 13, 2024
**TODO:**
- [ ] Python API and sample
- [ ] Update doc strings
- [x] Update main README.md (PR
#930)
- [ ] Add sample with custom device mapping
- [ ] Experiment with reshape + compile as part of Ctor
- [x] Add LoRA (PR
#911)
- [X] Use std::optional for prompt2, prompt3 and maybe negative prompts
as well
- [X] Update
https://github.com/openvinotoolkit/openvino.genai/blob/master/src/docs/SUPPORTED_MODELS.md
with text 2 image generation models
ScottZhang812 pushed a commit to ScottZhang812/_openvino.genai that referenced this pull request Dec 23, 2024
**TODO:**
- [ ] Python API and sample
- [ ] Update doc strings
- [x] Update main README.md (PR
openvinotoolkit/openvino.genai#930)
- [ ] Add sample with custom device mapping
- [ ] Experiment with reshape + compile as part of Ctor
- [x] Add LoRA (PR
openvinotoolkit/openvino.genai#911)
- [X] Use std::optional for prompt2, prompt3 and maybe negative prompts
as well
- [X] Update
https://github.com/openvinotoolkit/openvino.genai/blob/master/src/docs/SUPPORTED_MODELS.md
with text 2 image generation models
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants