cambridgeltl / PairS
Aligning with Human Judgement: The Role of Pairwise Preference in Large Language Model Evaluators (Liu et al.; COLM 2024)
☆42Updated 3 weeks ago
Alternatives and similar repositories for PairS:
Users that are interested in PairS are comparing it to the libraries listed below
- Codebase for Instruction Following without Instruction Tuning☆33Updated 4 months ago
- Scalable Meta-Evaluation of LLMs as Evaluators☆42Updated last year
- Code and data for paper "Context-faithful Prompting for Large Language Models".☆39Updated last year
- Repository for NPHardEval, a quantified-dynamic benchmark of LLMs☆51Updated 10 months ago
- [ACL'24] Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"☆54Updated 11 months ago
- [ICLR 2025] InstructRAG: Instructing Retrieval-Augmented Generation via Self-Synthesized Rationales☆71Updated last week
- Codebase accompanying the Summary of a Haystack paper.☆74Updated 4 months ago
- ☆116Updated 4 months ago
- ☆66Updated last year
- [NeurIPS 2024] Train LLMs with diverse system messages reflecting individualized preferences to generalize to unseen system messages☆42Updated 2 months ago
- [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search☆69Updated 2 months ago
- BRIGHT: A Realistic and Challenging Benchmark for Reasoning-Intensive Retrieval☆73Updated this week
- ☆13Updated 11 months ago
- Middleware for LLMs: Tools Are Instrumental for Language Agents in Complex Environments (EMNLP'2024)☆35Updated last month
- Lightweight tool to identify Data Contamination in LLMs evaluation☆46Updated 11 months ago
- ☆36Updated 6 months ago
- Official repository for MATES: Model-Aware Data Selection for Efficient Pretraining with Data Influence Models [NeurIPS 2024]☆58Updated 3 months ago
- ☆22Updated last month
- A simple GPT-based evaluation tool for multi-aspect, interpretable assessment of LLMs.☆83Updated last year
- ☆40Updated 8 months ago
- ☆17Updated 4 months ago
- Prompting Large Language Models to Generate Dense and Sparse Representations for Zero-Shot Document Retrieval☆40Updated 3 months ago
- ☆39Updated 6 months ago
- Repository for "Propagating Knowledge Updates to LMs Through Distillation" (NeurIPS 2023).☆25Updated 5 months ago
- We have released the code and demo program required for LLM with self-verification☆54Updated last year
- Code implementation of synthetic continued pretraining☆87Updated last month
- Long Context Extension and Generalization in LLMs☆48Updated 4 months ago
- List of papers on Self-Correction of LLMs.☆71Updated last month
- [EMNLP'24 (Main)] DRPO(Dynamic Rewarding with Prompt Optimization) is a tuning-free approach for self-alignment. DRPO leverages a search-…☆20Updated 2 months ago