Alternatives and similar repositories for VibeCheck

Users that are interested in VibeCheck are comparing it to the libraries listed below

• oriyor / assistantbench
  Implementation of the paper: "AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?"
  ☆62Updated 9 months ago
• ZeroSumEval / ZeroSumEval
  A framework for pitting LLMs against each other in an evolving library of games ⚔
  ☆33Updated 5 months ago
• para-lost / ReBase
  ReBase: Training Task Experts through Retrieval Based Distillation
  ☆29Updated 7 months ago
• HazyResearch / aioli
  Aioli: A unified optimization framework for language model data mixing
  ☆27Updated 8 months ago
• mungg / FABLES
  ☆57Updated last year
• allenai / infinigram-api
  ☆81Updated this week
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆60Updated last year
• bespokelabsai / verifiers
  Verifiers for LLM Reinforcement Learning
  ☆74Updated 5 months ago
• pgasawa / BARE
  Leveraging Base Language Models for Few-Shot Synthetic Data Generation
  ☆34Updated last month
• felipemaiapolo / tinyBenchmarks
  Evaluating LLMs with fewer examples
  ☆161Updated last year
• facebookresearch / collaborative-reasoner
  Source code for the collaborative reasoner research project at Meta FAIR.
  ☆103Updated 5 months ago
• huggingface / wikirace-llms
  ☆24Updated 4 months ago
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆89Updated 11 months ago
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆79Updated last year
• r-three / phatgoose
  Code for PHATGOOSE introduced in "Learning to Route Among Specialized Experts for Zero-Shot Generalization"
  ☆88Updated last year
• leap-laboratories / PIZZA
  An attribution library for LLMs
  ☆42Updated last year
• allenai / super-benchmark
  ☆47Updated 5 months ago
• tianyang-x / SaySelf
  Public code repo for paper "SaySelf: Teaching LLMs to Express Confidence with Self-Reflective Rationales"
  ☆108Updated 11 months ago
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆49Updated 7 months ago
• kanishkg / stream-of-search
  Repository for the paper Stream of Search: Learning to Search in Language
  ☆151Updated 7 months ago
• orionw / promptriever
  The first dense retrieval model that can be prompted like an LM
  ☆89Updated 4 months ago
• microsoft / eureka-ml-insights
  A framework for standardizing evaluations of large foundation models, beyond single-score reporting and rankings.
  ☆168Updated last week
• HishamAlyahya / semantic_backprop
  Source code of "How to Correctly do Semantic Backpropagation on Language-based Agentic Systems" 🤖
  ☆75Updated 9 months ago
• allenai / hybrid-preferences
  Learning to route instances for Human vs AI Feedback (ACL Main '25)
  ☆24Updated 2 months ago
• gangiswag / infogent
  ☆22Updated 6 months ago
• egozverev / Should-It-Be-Executed-Or-Processed
  Accompanying code and SEP dataset for the "Can LLMs Separate Instructions From Data? And What Do We Even Mean By That?" paper.
  ☆55Updated 6 months ago
• Jiaxin-Pei / Prompting-with-Social-Roles
  ☆39Updated 11 months ago
• GAIR-NLP / scaleeval
  Scalable Meta-Evaluation of LLMs as Evaluators
  ☆42Updated last year
• facebookresearch / ExploreToM
  Code for ExploreTom
  ☆86Updated 3 months ago
• du-nlp-lab / MLR-Copilot
  ☆67Updated 5 months ago