lisadunlap / VibeCheckLinks
Automated Qualitative Analysis of LLMs (ICLR 2025)
☆52Updated 5 months ago
Alternatives and similar repositories for VibeCheck
Users that are interested in VibeCheck are comparing it to the libraries listed below
Sorting:
- ☆93Updated last month
- ☆59Updated last year
- Leveraging Base Language Models for Few-Shot Synthetic Data Generation☆38Updated 2 months ago
- Source code for the collaborative reasoner research project at Meta FAIR.☆111Updated 8 months ago
- A framework for standardizing evaluations of large foundation models, beyond single-score reporting and rankings.☆173Updated 3 weeks ago
- Implementation of the paper: "AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?"☆66Updated last year
- ☆90Updated last week
- ☆49Updated 8 months ago
- Official Repo for CRMArena and CRMArena-Pro☆126Updated last month
- Aioli: A unified optimization framework for language model data mixing☆31Updated 11 months ago
- An attribution library for LLMs☆46Updated last year
- A framework for pitting LLMs against each other in an evolving library of games ⚔☆34Updated 8 months ago
- Verifiers for LLM Reinforcement Learning☆80Updated 8 months ago
- Learning to route instances for Human vs AI Feedback (ACL Main '25)☆26Updated 5 months ago
- Codebase accompanying the Summary of a Haystack paper.☆80Updated last year
- Repository for the paper Stream of Search: Learning to Search in Language☆152Updated 10 months ago
- ReBase: Training Task Experts through Retrieval Based Distillation☆29Updated 10 months ago
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆61Updated last year
- ☆42Updated last year
- Code for our paper PAPILLON: PrivAcy Preservation from Internet-based and Local Language MOdel ENsembles☆61Updated 7 months ago
- ☆24Updated 9 months ago
- The first dense retrieval model that can be prompted like an LM☆89Updated 7 months ago
- [ACL 2024] Do Large Language Models Latently Perform Multi-Hop Reasoning?☆84Updated 9 months ago
- ☆53Updated 10 months ago
- Analysis code for Neurips 2025 paper "SciArena: An Open Evaluation Platform for Foundation Models in Scientific Literature Tasks"☆55Updated 4 months ago
- ☆25Updated 7 months ago
- ☆112Updated 10 months ago
- Code for "Utility Engineering: Analyzing and Controlling Emergent Value Systems in AIs"☆85Updated 10 months ago
- Code for PHATGOOSE introduced in "Learning to Route Among Specialized Experts for Zero-Shot Generalization"☆91Updated last year
- The code implementation of MAGDi: Structured Distillation of Multi-Agent Interaction Graphs Improves Reasoning in Smaller Language Models…☆38Updated last year