psunlpgroup / ReaLMistakeLinks
This repository includes a benchmark and code for the paper "Evaluating LLMs at Detecting Errors in LLM Responses".
☆30Updated 10 months ago
Alternatives and similar repositories for ReaLMistake
Users that are interested in ReaLMistake are comparing it to the libraries listed below
Sorting:
- Tasks for describing differences between text distributions.☆16Updated 11 months ago
- Scalable Meta-Evaluation of LLMs as Evaluators☆42Updated last year
- Code Prompting Elicits Conditional Reasoning Abilities in Text+Code LLMs. EMNLP 2024☆25Updated 8 months ago
- [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"☆54Updated last year
- ☆44Updated 10 months ago
- ☆22Updated 6 months ago
- Are LLMs Capable of Data-based Statistical and Causal Reasoning? Benchmarking Advanced Quantitative Reasoning with Data☆41Updated 4 months ago
- ☆29Updated last year
- Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model☆43Updated last year
- [NeurIPS 2023 Main Track] This is the repository for the paper titled "Don’t Stop Pretraining? Make Prompt-based Fine-tuning Powerful Lea…☆74Updated last year
- Aligning with Human Judgement: The Role of Pairwise Preference in Large Language Model Evaluators (Liu et al.; COLM 2024)☆47Updated 5 months ago
- Evaluate the Quality of Critique☆36Updated last year
- Evaluation on Logical Reasoning and Abstract Reasoning Challenges☆28Updated 2 months ago
- Aioli: A unified optimization framework for language model data mixing☆27Updated 5 months ago
- Resolving Knowledge Conflicts in Large Language Models, COLM 2024☆17Updated last month
- FollowIR: Evaluating and Teaching Information Retrieval Models to Follow Instructions☆45Updated last year
- A simple GPT-based evaluation tool for multi-aspect, interpretable assessment of LLMs.☆85Updated last year
- Few-shot Learning with Auxiliary Data☆28Updated last year
- ☆35Updated 2 years ago
- ☆45Updated 3 months ago
- [ICLR'24 spotlight] Tool-Augmented Reward Modeling☆50Updated last month
- ☆19Updated last year
- This is the oficial repository for "Safer-Instruct: Aligning Language Models with Automated Preference Data"☆17Updated last year
- the instructions and demonstrations for building a formal logical reasoning capable GLM☆53Updated 10 months ago
- ☆54Updated last year
- This is official project in our paper: Is Bigger and Deeper Always Better? Probing LLaMA Across Scales and Layers☆30Updated last year
- CodeUltraFeedback: aligning large language models to coding preferences☆71Updated last year
- Repository for Skill Set Optimization☆14Updated 11 months ago
- [NAACL 2024 Findings] Evaluation suite for the systematic evaluation of instruction selection methods.☆22Updated last year
- Code/data for MARG (multi-agent review generation)☆44Updated 8 months ago