Issues: open-compass/opencompass
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
[Bug] run with transformers==4.40.2, error "HuggingFacewithChatTemplate does not support ppl-based evaluation".
#1157
opened May 15, 2024 by
zhulinJulia24
2 tasks done
storycloze_gen 测试不通过,显示torch.distributed.elastic.multiprocessing.api.SignalException [Feature]
#1142
opened May 12, 2024 by
dh12306
1 task
[Bug] Base classes use
@abstractmethod
without subclassing from abc.ABC
#1124
opened May 8, 2024 by
acylam
2 tasks done
[Feature] 请问在使用VLLM测评模型humaneval时,batch_size 不同导致 测评结果有区别是为什么?
#1097
opened Apr 26, 2024 by
noforit
1 task
[Feature] 是否可以对arc-e和arc-c的base模型评估增加25-shot with choice
#1082
opened Apr 24, 2024 by
siftxxx
1 task
[Bug] There is a large gap in the partial subset of the long text evaluation data set
#1061
opened Apr 19, 2024 by
bullw
2 tasks done
Previous Next
ProTip!
Type g p on any issue or pull request to go back to the pull request listing page.