Replies: 1 comment
-
如果是用 lmdeploy的话,转完模型之后, workspace/triton_models/weights/config.ini中的session_len可以调节 |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
如果是用 lmdeploy的话,转完模型之后, workspace/triton_models/weights/config.ini中的session_len可以调节
Beta Was this translation helpful? Give feedback.
All reactions