psunlpgroup / ReaLMistakeLinks
This repository includes a benchmark and code for the paper "Evaluating LLMs at Detecting Errors in LLM Responses".
☆29Updated 9 months ago
Alternatives and similar repositories for ReaLMistake
Users that are interested in ReaLMistake are comparing it to the libraries listed below
Sorting:
- Scalable Meta-Evaluation of LLMs as Evaluators☆42Updated last year
- Evaluate the Quality of Critique☆35Updated last year
- [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"☆54Updated last year
- AbstainQA, ACL 2024☆25Updated 7 months ago
- Is In-Context Learning Sufficient for Instruction Following in LLMs? [ICLR 2025]☆30Updated 4 months ago
- This is the oficial repository for "Safer-Instruct: Aligning Language Models with Automated Preference Data"☆17Updated last year
- Code for the 2025 ACL publication "Fine-Tuning on Diverse Reasoning Chains Drives Within-Inference CoT Refinement in LLMs"☆26Updated this week
- ☆22Updated 5 months ago
- Code and data for paper "Context-faithful Prompting for Large Language Models".☆40Updated 2 years ago
- ☆42Updated 2 months ago
- Evaluation on Logical Reasoning and Abstract Reasoning Challenges☆27Updated last month
- ☆14Updated last year
- Middleware for LLMs: Tools Are Instrumental for Language Agents in Complex Environments (EMNLP'2024)☆36Updated 5 months ago
- ☆44Updated 9 months ago
- DuoGuard: A Two-Player RL-Driven Framework for Multilingual LLM Guardrails☆23Updated 3 months ago
- ☆41Updated last year
- Aioli: A unified optimization framework for language model data mixing☆25Updated 4 months ago
- ☆35Updated last year
- [EMNLP'24 (Main)] DRPO(Dynamic Rewarding with Prompt Optimization) is a tuning-free approach for self-alignment. DRPO leverages a search-…☆24Updated 6 months ago
- ✨ Resolving Knowledge Conflicts in Large Language Models, COLM 2024☆17Updated last week
- Tasks for describing differences between text distributions.☆16Updated 9 months ago
- Benchmarking Benchmark Leakage in Large Language Models☆51Updated last year
- Code/data for MARG (multi-agent review generation)☆43Updated 6 months ago
- Codebase for Instruction Following without Instruction Tuning☆34Updated 8 months ago
- ☆29Updated 10 months ago
- This repository contains some of the code used in the paper "Training Language Models with Langauge Feedback at Scale"☆27Updated 2 years ago
- ☆21Updated 2 years ago
- Code Prompting Elicits Conditional Reasoning Abilities in Text+Code LLMs. EMNLP 2024☆21Updated 6 months ago
- LongHeads: Multi-Head Attention is Secretly a Long Context Processor☆29Updated last year
- ☆19Updated last year