UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform root cause analysis on failure cases and give insights on how to resolve them.

Benchmarking the Hallucination of Chinese Large Language Models via Unconstrained Generation

An Easy-to-use Hallucination Detection Framework for LLMs.

Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute, relative and much more. It contains a list of all the available tool, methods, repo, code etc to detect hallucination, LLM evaluation, grading and much more.

Aimon Rely is a state-of-the-art, multi-model API that provides detectors for LLM quality metrics in both offline evaluation and online monitoring scenarios.

[ACL 2024] An Easy-to-use Hallucination Detection Framework for LLMs.

🔢Hallucination detector for Large Language Models.

Competition: SemEval-2024 Task-6 - SHROOM, a Shared-task on Hallucinations and Related Observable Overgeneration Mistakes

Hallucination in Chat-bots: Faithful Benchmark for Information-Seeking Dialogue