New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Question] 请问继续预训练的loss降到什么水平是合格的 #115

Open

5 tasks done

parkLGW opened this issue Jul 21, 2023 · 0 comments

Open

5 tasks done

[Question] 请问继续预训练的loss降到什么水平是合格的 #115

parkLGW opened this issue Jul 21, 2023 · 0 comments

Labels

question

parkLGW commented Jul 21, 2023

Required prerequisites

I have read the documentation https://github.com/baichuan-inc/baichuan-7B/blob/HEAD/README.md.
I have searched the Issue Tracker and Discussions that this hasn't already been reported. (+1 or comment there if it has.)
Consider asking first in a Discussion.

Questions

用自有数据继续预训练，loss一直在2.1左右，请问是正常的吗

Checklist

I have provided all relevant and necessary information above.
I have chosen a suitable title for this issue.

parkLGW added the question label

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment