-
Notifications
You must be signed in to change notification settings - Fork 398
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
TypeError: forward() missing 1 required positional argument: 'hidden_states'[BUG] ? #636
Comments
@silvacarl2 Try 1) use latest 4.39.3 (latest) transformer or 4.38.2 (stable) 2) install autogtq from repo using git clone |
nope: python convert-to-gptq.py -m ./gpt-cmd -o ./gpt-cmd-gptq will try to build the Docker. |
Docker file seems to be out of date? get this error: $ docker build --no-cache --force-rm -t autogptq . => ERROR [9/9] RUN pip install -vvv . 1.9s
Dockerfile:2826 | WORKDIR /AutoGPTQ
|
Describe the bug
We get this error when trying to convert a fine tuned gpt-j model to gptq:
TypeError: forward() missing 1 required positional argument: 'hidden_states'
Hardware details
A40
Software version
nvcc --version
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2022 NVIDIA Corporation
Built on Wed_Sep_21_10:33:58_PDT_2022
Cuda compilation tools, release 11.8, V11.8.89
Build cuda_11.8.r11.8/compiler.31833905_0
NVIDIA-SMI 535.161.08 Driver Version: 535.161.08 CUDA Version: 12.2
Any ideas?
The text was updated successfully, but these errors were encountered: