Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Vulkan generation behaves weird with Falcon model and amdvlk driver #1581

Closed
2 tasks
manyoso opened this issue Oct 27, 2023 · 2 comments
Closed
2 tasks

Vulkan generation behaves weird with Falcon model and amdvlk driver #1581

manyoso opened this issue Oct 27, 2023 · 2 comments
Assignees
@manyoso
Labels
bug Something isn't working chat gpt4all-chat issues vulkan
Milestone
current sprint

Comments

@manyoso
Copy link
Collaborator

manyoso commented Oct 27, 2023

System Info

Occurs with latest version and latest master

Information

  • The official example notebooks/scripts
  • My own modified scripts

Reproduction

  1. Load GPT4All Falcon on AMD GPU with amdvlk driver on linux or recent windows driver
  2. Type anything for prompt
  3. Observe
    image

Expected behavior

Normal generation like we get with CPU
@manyoso manyoso self-assigned this Oct 27, 2023
@manyoso manyoso added vulkan bug Something isn't working chat gpt4all-chat issues labels Oct 27, 2023
@manyoso manyoso added this to the current sprint milestone Oct 27, 2023
@manyoso manyoso mentioned this issue Oct 27, 2023
Closed
@manyoso
Copy link
Collaborator Author

manyoso commented Oct 27, 2023

This is fixed with reverting nomic-ai/llama.cpp@500689a

@manyoso
Copy link
Collaborator Author

manyoso commented Oct 28, 2023 •
edited by cebtenzzre
Loading

Fixed with nomic-ai/llama.cpp@f038196 and nomic-ai/llama.cpp@03a4e98

@manyoso manyoso closed this as completed Oct 28, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@manyoso manyoso

Labels
bug Something isn't working chat gpt4all-chat issues vulkan
Projects
No open projects
(Archived) GPT4All 2024 Roadmap and Active Issues
Archived in project
Milestone
current sprint
Development

No branches or pull requests
1 participant
@manyoso