psunlpgroup / ReaLMistake
This repository includes a benchmark and code for the paper "Evaluating LLMs at Detecting Errors in LLM Responses".
☆27Updated 5 months ago
Alternatives and similar repositories for ReaLMistake:
Users that are interested in ReaLMistake are comparing it to the libraries listed below
- Scalable Meta-Evaluation of LLMs as Evaluators☆42Updated 11 months ago
- Evaluate the Quality of Critique☆35Updated 7 months ago
- [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"☆53Updated 10 months ago
- ☆23Updated last month
- ☆26Updated 6 months ago
- ☆36Updated 5 months ago
- ☆38Updated 3 months ago
- [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search☆68Updated last month
- Data and code for the preprint "In-Context Learning with Long-Context Models: An In-Depth Exploration"☆31Updated 4 months ago
- Aligning with Human Judgement: The Role of Pairwise Preference in Large Language Model Evaluators (Liu et al.; COLM 2024)☆40Updated 3 weeks ago
- BRIGHT: A Realistic and Challenging Benchmark for Reasoning-Intensive Retrieval☆66Updated 2 weeks ago
- Middleware for LLMs: Tools Are Instrumental for Language Agents in Complex Environments (EMNLP'2024)☆35Updated 2 weeks ago
- ☆44Updated 4 months ago
- Tasks for describing differences between text distributions.☆16Updated 5 months ago
- Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model☆42Updated last year
- [arXiv preprint] Official Repository for "Evaluating Language Models as Synthetic Data Generators"☆30Updated last month
- ☆38Updated 5 months ago
- Adding new tasks to T0 without catastrophic forgetting☆32Updated 2 years ago
- ☆33Updated 9 months ago
- Code/data for MARG (multi-agent review generation)☆36Updated 2 months ago
- This is official project in our paper: Is Bigger and Deeper Always Better? Probing LLaMA Across Scales and Layers☆28Updated last year
- Critique-out-Loud Reward Models☆47Updated 3 months ago
- CodeUltraFeedback: aligning large language models to coding preferences☆66Updated 6 months ago
- ☆20Updated this week
- Supporting code for ReCEval paper☆27Updated 4 months ago
- Is In-Context Learning Sufficient for Instruction Following in LLMs?☆26Updated 7 months ago
- This is the implementation for the paper "LARGE LANGUAGE MODEL CASCADES WITH MIX- TURE OF THOUGHT REPRESENTATIONS FOR COST- EFFICIENT REA…☆19Updated 7 months ago
- LongHeads: Multi-Head Attention is Secretly a Long Context Processor☆28Updated 9 months ago
- Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"☆46Updated last year
- [EMNLP'24 (Main)] DRPO(Dynamic Rewarding with Prompt Optimization) is a tuning-free approach for self-alignment. DRPO leverages a search-…☆18Updated 2 months ago