Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Meaningless strings for slightly bigger prompts when running on GPU #2280

Open
rds0001 opened this issue Apr 29, 2024 · 0 comments
Open

Meaningless strings for slightly bigger prompts when running on GPU #2280

rds0001 opened this issue Apr 29, 2024 · 0 comments
Labels
bug-unconfirmed chat gpt4all-chat issues

Comments

@rds0001
Copy link

rds0001 commented Apr 29, 2024

Bug Report

I am running GPT4All on a Windows Laptop with an NVIDIA GeForce GTX 1070 graphic card.
It runs quite fast and correct for small prompts like "Write a story". For bigger prompts, however that consist of several sentences but are still within the allowed context window, I get only output like "�y▅qlnkhwmgvdut▅ai|{xpo][cW`▅s\X_bjz{ZUeR{|{▅{y^QYOuwvTx|" etc. I do not have this error when running on CPU.

Steps to Reproduce

  1. Start GPT4All.
  2. Enter a prompt that consists of a small article summary (4-5 sentences).

Expected Behavior

It should provide the summary as output.

Your Environment

  • GPT4All version: Newest version as of 04/29/2024
  • Operating System: Windows 10
  • Graphic Card: NVIDIA GeForce GTX 1070
  • Chat model used (if applicable): mistral-7b-instruct-v0.1.Q4_0.gguf
@rds0001 rds0001 added bug-unconfirmed chat gpt4all-chat issues labels Apr 29, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug-unconfirmed chat gpt4all-chat issues
Projects
None yet
Development

No branches or pull requests

1 participant