Aligning with Human Judgement: The Role of Pairwise Preference in Large Language Model Evaluators (Liu et al.; COLM 2024)
☆49Jan 21, 2025Updated last year
Alternatives and similar repositories for PairS
Users that are interested in PairS are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Fairer Preferences Elicit Improved Human-Aligned Large Language Model Judgments (Zhou et al., EMNLP 2024)☆14Oct 3, 2024Updated last year
- HANNA, a large annotated dataset of Human-ANnotated NArratives for ASG evaluation.☆38Oct 15, 2024Updated last year
- Code for ACL 2020 paper: USR: An Unsupervised and Reference Free Evaluation Metric for Dialog Generation (https://arxiv.org/pdf/2005.0045…☆50Dec 8, 2022Updated 3 years ago
- Introductory Python course for computational lingustics☆26Aug 20, 2024Updated last year
- EMNLP 2022: Analyzing and Evaluating Faithfulness in Dialogue Summarization☆13Mar 20, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- This is the official repo for Towards Uncertainty-Aware Language Agent.☆31Aug 15, 2024Updated last year
- Learning to route instances for Human vs AI Feedback (ACL Main '25)☆29Jul 23, 2025Updated 11 months ago
- JMLR Cover Letter Template☆10Dec 15, 2021Updated 4 years ago
- ☆23Feb 26, 2024Updated 2 years ago
- Codebase for EA Modeling (for Transactions on Affective Computing paper)☆12Dec 8, 2022Updated 3 years ago
- Repo for "On Learning to Summarize with Large Language Models as References"☆44May 24, 2023Updated 3 years ago
- ☆80Jun 25, 2026Updated 2 weeks ago
- [NAACL(2019)] Generating Knowledge Graph Paths from Textual Definitions using Sequence-to-Sequence Models☆11Apr 27, 2022Updated 4 years ago
- ☆10Oct 22, 2024Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆18Aug 19, 2024Updated last year
- Restore safety in fine-tuned language models through task arithmetic☆33Mar 28, 2024Updated 2 years ago
- ☆17Nov 30, 2021Updated 4 years ago
- [NeurIPS 2023 D&B Track] Code and data for paper "Revisiting Out-of-distribution Robustness in NLP: Benchmarks, Analysis, and LLMs Evalua…☆37Jun 8, 2023Updated 3 years ago
- [WNGT(2019)] On the Importance of the Kullback-Leibler Divergence Term in Variational Autoencoders for Text Generation☆11Apr 27, 2022Updated 4 years ago
- Making graphs of player-player connections on twitter☆12Dec 17, 2018Updated 7 years ago
- ☆11Sep 25, 2025Updated 9 months ago
- [NAACL 2025] Representing Rule-based Chatbots with Transformers☆23Feb 9, 2025Updated last year
- SPUQ: Perturbation-Based Uncertainty Quantification for Large Language Models☆17Jun 24, 2024Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Fediverse Intelligence Recommendations Replication Endpoint Server☆28Mar 27, 2026Updated 3 months ago
- [ICML 2022] Latent Diffusion Energy-Based Model for Interpretable Text Modeling☆67Mar 1, 2026Updated 4 months ago
- ☆16Jul 23, 2024Updated last year
- TopViewRS: Vision-Language Models as Top-View Spatial Reasoners (EMNLP 2024 Oral)☆15Jun 14, 2025Updated last year
- Few-shot Learning with Auxiliary Data☆31Dec 8, 2023Updated 2 years ago
- ☆93Aug 18, 2024Updated last year
- Codebase for Instruction Following without Instruction Tuning☆36Sep 24, 2024Updated last year
- Data Valuation on In-Context Examples (ACL23)☆24Jan 12, 2025Updated last year
- ☆15Oct 9, 2021Updated 4 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- [NeurIPS 2024] Self-Optimization Improves the Efficiency of Code Generation☆14May 10, 2025Updated last year
- ☆10Dec 21, 2019Updated 6 years ago
- Automatic prompt optimization framework for multi-step agent tasks.☆37Nov 12, 2024Updated last year
- Multi-Task Pre-Training for Plug-and-Play Task-Oriented Dialogue System (ACL 2022)☆162Dec 20, 2023Updated 2 years ago
- Official implementation of "CONCRETE: Improving Cross-lingual Fact Checking with Cross-lingual Retrieval" (COLING'22)☆15Oct 13, 2022Updated 3 years ago
- Code and example data for the paper: Rule Based Rewards for Language Model Safety☆208Jul 19, 2024Updated last year
- Span and Rule Models for Neural Constituent Parsing☆10Jun 11, 2018Updated 8 years ago