-
Notifications
You must be signed in to change notification settings - Fork 452
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Qlora如何指定某一张卡,单卡训练? #235
Comments
可以在训练启动的时候通过
|
单卡可以用上面的方式。 但多卡训练,上面方式能启动,但好像没有真正的多卡并行,因为想优化配置参数,但显存占用及需要的训练耗时没有变化。 改用
|
device_map={“”:0} |
学到了 这就回去试试deepseed |
加载模型
这里的 device_map="auto", 会调用多卡训练,请问如何指定固定的显卡训练。 尝试过device_map={'': int(os.environ.get('LOCAL_RANK', '1'))} 以及 device_map = "cuda:1" 都不行,报错信息: 【RuntimeError: CUDA error: invalid device ordinal】
有没有大佬能帮忙解答下~ 感谢
The text was updated successfully, but these errors were encountered: