New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

请问如何减少训练时长 #14

Open

xiyuanhao opened this issue Apr 6, 2024 · 1 comment

xiyuanhao commented Apr 6, 2024

预训练loss 到1.4左右，step到900多就基本不动了，然后还一直训练？是我的显卡问题么？

Owner

Coobiw commented Apr 6, 2024

是在哪个setting跑的呢，然后loss趋于平缓也很正常，并不是说loss基本不动就会停止啊

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment