A holistic benchmark for LLM abstention
☆101Aug 27, 2025Updated last year
Alternatives and similar repositories for AbstentionBench
Users that are interested in AbstentionBench are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [NeurIPS 2026 🏆 Oral] AgentAbstain: Systematic Evaluation Framework of Agentic Abstention☆23Sep 28, 2026Updated last month
- ☆18Feb 2, 2026Updated 9 months ago
- Official code and data for Agentic Abstention, accepted at NeurIPS 2026.☆51Oct 8, 2026Updated last month
- PyTorch implementation of "SelectiveNet: A Deep Neural Network with an Integrated Reject Option" from Geifman et al. [ICML2019]☆10Oct 6, 2022Updated 4 years ago
- Adaptive-binning for evaluation of confidence calibration☆12Jul 28, 2019Updated 7 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- reproduces experiments from "Grounding inductive biases in natural images: invariance stems from variations in data"☆17Sep 25, 2024Updated 2 years ago
- Towards Meta-Pruning via Optimal Transport, ICLR 2024 (Spotlight)☆18Dec 5, 2024Updated last year
- LiveClin is a live benchmark designed for the faithful replication of clinical practice☆20Feb 27, 2026Updated 8 months ago
- Official repository for Beyond Binary Rewards: Training LMs to Reason about Their Uncertainty☆90Aug 20, 2025Updated last year
- This library supports evaluating disparities in generated image quality, diversity, and consistency between geographic regions.☆20Jun 3, 2024Updated 2 years ago
- Codebase for character-centric story understanding☆14Jan 20, 2022Updated 4 years ago
- ☆27May 14, 2026Updated 5 months ago
- ☆11May 18, 2025Updated last year
- [ACL 2025] LongSafety: Evaluating Long-Context Safety of Large Language Models☆16Jun 18, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Codebase for VidHal: Benchmarking Hallucinations in Vision LLMs☆14Apr 23, 2026Updated 6 months ago
- Mechanistic uncertainty calibration of LLMs.☆14Jan 13, 2026Updated 9 months ago
- ☆19Nov 3, 2025Updated last year
- [ICLR 2025 Spotlight] Weak-to-strong preference optimization: stealing reward from weak aligned model☆19Feb 24, 2025Updated last year
- Code for "DocLens: Multi-aspect Fine-grained Evaluation for Medical Text Generation" (ACL 2024)☆24May 18, 2024Updated 2 years ago
- A Hard Multi-Turn Hallucination Benchmark☆36Sep 17, 2026Updated last month
- This is the oficial repository for "Safer-Instruct: Aligning Language Models with Automated Preference Data"☆17Feb 22, 2024Updated 2 years ago
- A simple algorithm to identify and correct for label shift.☆21Feb 4, 2018Updated 8 years ago
- ☆12Sep 26, 2019Updated 7 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- [ICML 2024] Reducing Tool Hallucination via Reliability Alignment☆16Jun 17, 2025Updated last year
- [NeurIPS 2025] Official Implementation of paper "Sherlock: Self-Correcting Reasoning in Vision-Language Models"☆31Jun 4, 2026Updated 5 months ago
- ☆15Feb 21, 2024Updated 2 years ago
- Fact Verification for Clinical Notes with LLMs☆43Dec 22, 2025Updated 10 months ago
- Revisiting Mid-training in the Era of Reinforcement Learning Scaling☆188Jul 23, 2025Updated last year
- Forcing Diffuse Distributions out of Language Models☆18Sep 10, 2024Updated 2 years ago
- ☆38Feb 20, 2025Updated last year
- [ICLR 2026] BARREL: Boundary-Aware Reasoning for Factual and Reliable LRMs☆19May 21, 2025Updated last year
- ☆31Sep 12, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Official Implementation of CiteAgent Framework☆10Nov 18, 2025Updated 11 months ago
- ☆18Feb 4, 2026Updated 9 months ago
- Repository for reproducing `Model-Based Robust Deep Learning`☆17Jan 22, 2021Updated 5 years ago
- ☆16May 15, 2026Updated 5 months ago
- ☆13Dec 22, 2023Updated 2 years ago
- [EMNLP 24] ReCaLL: Membership Inference via Relative Conditional Log-Likelihoods.☆11Nov 27, 2024Updated last year
- Robustness for Non-Parametric Classification: A Generic Attack and Defense☆18Nov 21, 2022Updated 3 years ago