We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
通过vllm0.4.0使用该量化模型可以使用,通过dbgpt加载提示错误,看支持的模型清单里面没有这个,请问这个模型是不是现在还不兼容。
No response
The text was updated successfully, but these errors were encountered:
No branches or pull requests
Search before asking
Description
通过vllm0.4.0使用该量化模型可以使用,通过dbgpt加载提示错误,看支持的模型清单里面没有这个,请问这个模型是不是现在还不兼容。
Documentation Links
No response
Are you willing to submit PR?
The text was updated successfully, but these errors were encountered: