This repository includes a benchmark and code for the paper "Evaluating LLMs at Detecting Errors in LLM Responses".
☆32Aug 18, 2024Updated last year
Alternatives and similar repositories for ReaLMistake
Users that are interested in ReaLMistake are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- About The corresponding code from our paper " Making Reasoning Matter: Measuring and Improving Faithfulness of Chain-of-Thought Reasoning…☆13Jan 14, 2026Updated 3 months ago
- ☆19Dec 6, 2024Updated last year
- Implementation for the paper "Fictitious Synthetic Data Can Improve LLM Factuality via Prerequisite Learning"☆11Jan 10, 2025Updated last year
- Evaluate the Quality of Critique☆37Jun 1, 2024Updated last year
- A Public repository for the COMeT model☆13Jul 25, 2024Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Code and data for TACL paper It’s not Rocket Science: Interpreting Figurative Language in Narratives☆15Sep 4, 2023Updated 2 years ago
- ☆16Jul 16, 2024Updated last year
- Source codes for "Preference-grounded Token-level Guidance for Language Model Fine-tuning" (NeurIPS 2023).☆17Jan 8, 2025Updated last year
- ☆12Sep 29, 2024Updated last year
- A curated collection of papers and related projects on using LLMs for privacy.☆30Oct 8, 2025Updated 6 months ago
- Multi-sense word embeddings from visual co-occurrences☆25Sep 5, 2019Updated 6 years ago
- tensorflow Implementation of https://github.com/facebookresearch/MIXER☆11Mar 8, 2017Updated 9 years ago
- Code for paper "Prompt Engineering a Prompt Engineer" (https://arxiv.org/abs/2311.05661)☆10Aug 1, 2024Updated last year
- The official repository of "Improving Large Language Models via Fine-grained Reinforcement Learning with Minimum Editing Constraint"☆39Jan 12, 2024Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Toolkit for building prompt templates for language models☆12Sep 30, 2022Updated 3 years ago
- Implementation of the spotlight: a method for discovering systematic errors in deep learning models☆11Oct 5, 2021Updated 4 years ago
- L1: Controlling How Long A Reasoning Model Thinks With Reinforcement Learning☆265May 14, 2025Updated 11 months ago
- ☆12Feb 18, 2020Updated 6 years ago
- Microsoft question-answering dataset☆10Jun 16, 2023Updated 2 years ago
- Natural Language Reinforcement Learning☆102Jul 30, 2025Updated 9 months ago
- Masking tokens to modify the predictions of a pretrained sentence classifier☆16Feb 4, 2020Updated 6 years ago
- ☆19Nov 8, 2023Updated 2 years ago
- ☆53Apr 29, 2020Updated 6 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Kernel Playground - A playground to run large scale experiments on the Linux Kernel☆21Nov 8, 2025Updated 5 months ago
- ☆11May 9, 2022Updated 3 years ago
- RARR: Researching and Revising What Language Models Say, Using Language Models☆53Jun 22, 2023Updated 2 years ago
- ☆18Sep 2, 2025Updated 8 months ago
- [ICSE 2023] Differentiable interpretation and failure-inducing input generation for neural network numerical bugs.☆13Jan 5, 2024Updated 2 years ago
- Code for EMNLP 2021 paper "CLIFF: Contrastive Learning for Improving Faithfulness and Factuality in Abstractive Summarization"☆47Jan 17, 2022Updated 4 years ago
- GisPy: A Tool for Measuring Gist Inference Score in Text https://aclanthology.org/2022.wnu-1.5/☆13Jul 1, 2024Updated last year
- NVIDIA’s repository for enabling trustworthy AI.☆32Updated this week
- ⚠️ ARCHIVED - All development moved to https://github.com/itbench-hub/ITBench/tree/main/scenarios☆15Feb 24, 2026Updated 2 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Failure dataset accompanying the paper "How Bad Can a Bug Get? An Empirical Analysis of Software Failures in the OpenStack Cloud Computi…☆10Jun 12, 2020Updated 5 years ago
- 用Paddle复现论文ChineseBERT: Chinese Pretraining Enhanced by Glyph and Pinyin Information（ACL2021）☆10Nov 15, 2021Updated 4 years ago
- Official implementation of Tabular Transfer Learning via Prompting LLMs (COLM 2024).☆13Aug 6, 2024Updated last year
- Repo of paper "Free Process Rewards without Process Labels"☆171Mar 14, 2025Updated last year
- ☆17Jul 4, 2025Updated 10 months ago
- ☆18May 14, 2025Updated 11 months ago
- ☆24Oct 31, 2018Updated 7 years ago