Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Include Python dependencies in README #6

Merged
merged 1 commit into from
Mar 11, 2023
Merged

Conversation

simonw
Copy link
Contributor

@simonw simonw commented Mar 11, 2023

Should maybe note that you need Python 3.10 - because there's no torch wheel yet for Python 3.11.

@simonw
Copy link
Contributor Author

simonw commented Mar 11, 2023

See also https://til.simonwillison.net/llms/llama-7b-m2

@ggerganov ggerganov merged commit 5f2f970 into ggerganov:master Mar 11, 2023
simonw added a commit to simonw/til that referenced this pull request Mar 11, 2023
This is documented in the LLaMA README now:
- ggerganov/llama.cpp#6
SlyEcho pushed a commit to SlyEcho/llama.cpp that referenced this pull request May 31, 2023
Buffer incomplete multibyte characters + other stuff.
ggerganov pushed a commit that referenced this pull request Oct 19, 2023
fix compilation errors with llvm
chsasank pushed a commit to chsasank/llama.cpp that referenced this pull request Dec 20, 2023
…gerganov#6)

* deprecate ffn_b

* get tensor offloading levels

* wip: split tensor loading

* wip: framework of loading sparse model tensors

* save and flush gpu alloc buffer

* vram budget will fall back to remaining free memory

* minor: remove vram safety margin

* add options for vram budget; clean old env vars

* minor: bugfix
chsasank pushed a commit to chsasank/llama.cpp that referenced this pull request Dec 20, 2023
* Update demo video in README.md

* Update demo at README.md
@Dyke-F Dyke-F mentioned this pull request Dec 21, 2023
3 tasks
@m828 m828 mentioned this pull request Jul 16, 2024
@fan-chao fan-chao mentioned this pull request Aug 13, 2024
4 tasks
@slaren slaren mentioned this pull request Aug 15, 2024
4 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants