You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
that I am running inside a for loop to generate a list of task.
Just to understand,
for task in tasks:
run(model, task, port)
Sometimes everything goes great and I obtain an answer which is later written on an output file, while sometimes I obtain an infinite loop of slot 0: context shift - n_keep = 0, n_left = 510, n_discard = 255 and an error slot unavailable.
I am running the server in another shell with ./models/codeninja-1.0-openchat-7b.Q4_K_M-server.llamafile --port 8081 --nobrowser --threads 8 -ngl 9999
how can I solve this:
The text was updated successfully, but these errors were encountered:
This is the code
that I am running inside a for loop to generate a list of task.
Just to understand,
Sometimes everything goes great and I obtain an answer which is later written on an output file, while sometimes I obtain an infinite loop of
slot 0: context shift - n_keep = 0, n_left = 510, n_discard = 255
and an errorslot unavailable
.I am running the server in another shell with
./models/codeninja-1.0-openchat-7b.Q4_K_M-server.llamafile --port 8081 --nobrowser --threads 8 -ngl 9999
how can I solve this:
The text was updated successfully, but these errors were encountered: