psunlpgroup / ReaLMistake
This repository includes a benchmark and code for the paper "Evaluating LLMs at Detecting Errors in LLM Responses".
☆27Updated 7 months ago
Alternatives and similar repositories for ReaLMistake:
Users that are interested in ReaLMistake are comparing it to the libraries listed below
- Scalable Meta-Evaluation of LLMs as Evaluators☆42Updated last year
- ☆39Updated 7 months ago
- [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search☆70Updated 3 months ago
- ☆22Updated 3 months ago
- ☆41Updated last year
- Dialogue Action Tokens: Steering Language Models in Goal-Directed Dialogue with a Multi-Turn Planner☆22Updated 8 months ago
- Tasks for describing differences between text distributions.☆16Updated 7 months ago
- Evaluate the Quality of Critique☆35Updated 9 months ago
- ☆39Updated 7 months ago
- ☆44Updated 6 months ago
- Is In-Context Learning Sufficient for Instruction Following in LLMs? [ICLR 2025]☆29Updated 2 months ago
- Data and code for the preprint "In-Context Learning with Long-Context Models: An In-Depth Exploration"☆32Updated 7 months ago
- LongHeads: Multi-Head Attention is Secretly a Long Context Processor☆29Updated 11 months ago
- ☆23Updated 2 months ago
- [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"☆54Updated last year
- AbstainQA, ACL 2024☆25Updated 5 months ago
- DuoGuard: A Two-Player RL-Driven Framework for Multilingual LLM Guardrails☆16Updated 3 weeks ago
- FollowIR: Evaluating and Teaching Information Retrieval Models to Follow Instructions☆42Updated 8 months ago
- Implementation of "SelfCite: Self-Supervised Alignment for Context Attribution in Large Language Models"☆26Updated last month
- Evaluation on Logical Reasoning and Abstract Reasoning Challenges☆25Updated last year
- ☆19Updated last year
- ☆34Updated last year
- Repository for Skill Set Optimization☆12Updated 7 months ago
- Codebase for Instruction Following without Instruction Tuning☆33Updated 6 months ago
- Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model☆42Updated last year
- Prompting Large Language Models to Generate Dense and Sparse Representations for Zero-Shot Document Retrieval☆43Updated 5 months ago
- IntructIR, a novel benchmark specifically designed to evaluate the instruction following ability in information retrieval models. Our foc…☆31Updated 9 months ago
- ☆26Updated 8 months ago
- Code for ICLR 2024 paper "CRAFT: Customizing LLMs by Creating and Retrieving from Specialized Toolsets"☆52Updated 9 months ago
- Aioli: A unified optimization framework for language model data mixing☆22Updated 2 months ago