☆444Mar 3, 2026Updated this week
Alternatives and similar repositories for lm-polygraph
Users that are interested in lm-polygraph are comparing it to the libraries listed below
Sorting:
- [ACL 2024] Shifting Attention to Relevance: Towards the Predictive Uncertainty Quantification of Free-Form Large Language Models☆62Sep 4, 2024Updated last year
- ☆185Jun 20, 2024Updated last year
- ☆23Feb 23, 2026Updated last week
- ☆42Feb 2, 2024Updated 2 years ago
- Codebase for reproducing the experiments of the semantic uncertainty paper (short-phrase and sentence-length experiments).☆406Apr 12, 2024Updated last year
- ☆35May 30, 2022Updated 3 years ago
- Benchmarking LLMs via Uncertainty Quantification☆260Jan 30, 2024Updated 2 years ago
- Align your LM to express calibrated verbal statements of confidence in its long-form generations.☆29Jun 4, 2024Updated last year
- [NAACL'25 Oral] Steering Knowledge Selection Behaviours in LLMs via SAE-Based Representation Engineering☆76Jan 16, 2026Updated last month
- Awesome-LLM-Robustness: a curated list of Uncertainty, Reliability and Robustness in Large Language Models☆812May 21, 2025Updated 9 months ago
- Uncertainty quantification for in-context learning of large language models☆15Apr 1, 2024Updated last year
- A package to evaluate factuality of long-form generation. Original implementation of our EMNLP 2023 paper "FActScore: Fine-grained Atomic…☆417Apr 13, 2025Updated 10 months ago
- code repo for ICLR 2024 paper "Can LLMs Express Their Uncertainty? An Empirical Evaluation of Confidence Elicitation in LLMs"☆145Mar 14, 2024Updated last year
- Codebase for reproducing the experiments of the semantic uncertainty paper (paragraph-length experiments).☆80Apr 12, 2024Updated last year
- ☆11Jul 6, 2024Updated last year
- ☆42Dec 9, 2024Updated last year
- This is the repository of HaluEval, a large-scale hallucination evaluation benchmark for Large Language Models.☆556Feb 12, 2024Updated 2 years ago
- Model zoo for different kinds of uncertainty quantification methods used in Natural Language Processing, implemented in PyTorch.☆55May 5, 2023Updated 2 years ago
- List of papers on hallucination detection in LLMs.☆1,055Jan 11, 2026Updated last month
- ☆52Jul 31, 2024Updated last year
- [NeurIPS 2024] Uncertainty of Thoughts: Uncertainty-Aware Planning Enhances Information Seeking in Large Language Models☆106Aug 5, 2024Updated last year
- Code for "A Data-Centric Approach To Generate Faithful and High Quality Patient Summaries with Large Language Models"☆17Jul 20, 2025Updated 7 months ago
- Synthetic QA generation for long documents.☆16Jul 22, 2022Updated 3 years ago
- This is the official repo for Towards Uncertainty-Aware Language Agent.☆31Aug 15, 2024Updated last year
- FrugalScore is an approach to learn a fixed, low cost version of any expensive NLG metric, while retaining most of its original performan…☆16Sep 21, 2022Updated 3 years ago
- SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Models☆602Jun 26, 2024Updated last year
- Active learning☆79Feb 8, 2023Updated 3 years ago
- ☆58Jun 30, 2023Updated 2 years ago
- Conformal Language Modeling☆31Dec 21, 2023Updated 2 years ago
- ☆53Apr 9, 2025Updated 10 months ago
- Reinforcement learning (RL) is an effective method to find reasoning pathways in incomplete knowledge graphs (KGs). To overcome the chall…☆24Oct 13, 2024Updated last year
- ☆19Nov 11, 2023Updated 2 years ago
- Code for our EMNLP '22 paper "Fixing Model Bugs with Natural Language Patches"☆19Dec 7, 2022Updated 3 years ago
- Token-level Reference-free Hallucination Detection☆97Jul 25, 2023Updated 2 years ago
- ☆38Apr 17, 2024Updated last year
- ☆11May 18, 2022Updated 3 years ago
- ComfyUI workflows to create smooth transitions between video clips using Wan VACE. Works with video from any model or other source-LTX-2,…☆31Feb 10, 2026Updated 3 weeks ago
- A framework for evaluating Machine Translation models.☆12May 26, 2025Updated 9 months ago
- Code for the EMNLP 2021 Paper "Active Learning by Acquiring Contrastive Examples" & the ACL 2022 Paper "On the Importance of Effectively …☆128May 24, 2022Updated 3 years ago