Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

多卡启动自定义模型时，报Remote server unixsocket错误 #1474

Open
mrkingsun opened this issue May 11, 2024 · 2 comments
Open

多卡启动自定义模型时，报Remote server unixsocket错误 #1474

mrkingsun opened this issue May 11, 2024 · 2 comments
Labels
gpu question Further information is requested
Milestone
v0.12.1

Comments

@mrkingsun
Copy link

两张卡，第一张（12G/32G）,第二张（1G/32G）。模型是internlm2-chat-7b。

  • 只使用第二张卡加载，显存占用大概30G，可以正常启动；
  • 因为占用快满了，想利用下第一张卡，在注册页面设置了gpu-index为0，1。启动时就报错Remote server unixsocket
@mrkingsun mrkingsun added the question Further information is requested label May 11, 2024
@XprobeBot XprobeBot added the gpu label May 11, 2024
@XprobeBot XprobeBot modified the milestones: v0.11.0, v0.11.1, v0.11.2 May 11, 2024
@codingl2k1
Copy link
Contributor

有没有服务端的错误信息？

@mrkingsun
Copy link
Author

解决了，检索了一下是docker内存不足，在run的时候加上--shm-size=10.24gb即可

@XprobeBot XprobeBot modified the milestones: v0.11.2, v0.11.3 May 24, 2024
@XprobeBot XprobeBot modified the milestones: v0.11.3, v0.11.4, v0.12.0, v0.12.1 May 31, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
gpu question Further information is requested
Projects
None yet
Milestone
v0.12.1
Development

No branches or pull requests
3 participants
@mrkingsun @XprobeBot @codingl2k1