New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Question] 参数合并后有什么要注意的吗？我将7B参数和微调参数合并之后，加载新模型，显存占用超过了24G，这个跟原始7B所需显存差很多？这会是什么导致的 #142

Open

5 tasks done

Micla-SHL opened this issue Feb 27, 2024 · 0 comments

Labels

question

Micla-SHL commented Feb 27, 2024

Required prerequisites

I have read the documentation https://github.com/baichuan-inc/baichuan-7B/blob/HEAD/README.md.
I have searched the Issue Tracker and Discussions that this hasn't already been reported. (+1 or comment there if it has.)
Consider asking first in a Discussion.

Questions

1

Checklist

I have provided all relevant and necessary information above.
I have chosen a suitable title for this issue.

Micla-SHL added the question label

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment