You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I try to use medusa on llama model,and do some medusa head experiments.
when base_model_config. medusa_num_heads in from_pretrained(medusa_model.py) is set to be 2 or 3, an error will be raised as follow;but if set to be 5, it seems to work well, Could you tell its reason for this?
The text was updated successfully, but these errors were encountered:
hi, @ctlllll
I try to use medusa on llama model,and do some medusa head experiments.
when base_model_config. medusa_num_heads in from_pretrained(medusa_model.py) is set to be 2 or 3, an error will be raised as follow;but if set to be 5, it seems to work well, Could you tell its reason for this?
The text was updated successfully, but these errors were encountered: