New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Bugfix convert_llama_weights_to_hf.py #30755

Open

helson73 wants to merge 1 commit into huggingface:main from helson73:main

helson73 commented May 11, 2024

What does this PR do?

Division with n_heads_kv_local is duplicated inside permute function, so removed.


          Update convert_llama_weights_to_hf.py

4f19804

Division with n_heads_kv_local is duplicated inside permute function, so removed.

Collaborator

amyeroberts commented May 13, 2024

cc @ArthurZucker

ArthurZucker reviewed

View reviewed changes

Collaborator

ArthurZucker left a comment

Hey, num_local_key_value_heads is not the same as n_heads

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment