-
Notifications
You must be signed in to change notification settings - Fork 246
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
BUG: Fail to run model "bge-reranker-v2-minicpm-layerwise" with Xinference v0.11.0 version (docker images) #1515
Comments
@codingl2k1 can you give a help? |
I am looking into this issue. |
This model works well on my Mac, and I can run the rerank benchmark on it, though it's very slow. Name: FlagEmbedding Name: transformers |
Which version of Xinference docker image did you use? |
Can you try to repeat my steps below? |
I will try your steps. |
I choose Register Model Tab,select "RERANK MODEL",fill in the parameters: model name and model path in docker container and choose English and Chinese. Finally,register. |
Describe the bug
I downloaded the "bge-reranker-v2-minicpm-layerwise" model weights to the server and registered this model (the registered model name is "bge-reranker-v2-minicpm-layerwise-self") with Xinference v0.11.0 version (docker images). Then I launched this model. However, it crushed. The error information is as follows:
To Reproduce
Expected behavior
No crush. According the Xinference docs (https://inference.readthedocs.io/en/latest/models/builtin/rerank/bge-reranker-v2-minicpm-layerwise.html),
bge-reranker-v2-minicpm-layerwise model
is supported.The text was updated successfully, but these errors were encountered: