Alternatives and similar repositories for VibeCheck

Users that are interested in VibeCheck are comparing it to the libraries listed below

• AkariAsai / OpenScholar_ExpertEval
  This repository contains expert evaluation interface and data evaluation script for the OpenScholar project.
  ☆24Updated 6 months ago
• HazyResearch / aioli
  Aioli: A unified optimization framework for language model data mixing
  ☆25Updated 4 months ago
• benediktstroebl / agent-evals
  ☆19Updated last week
• open-compass / ProSA
  [EMNLP 2024 Findings] ProSA: Assessing and Understanding the Prompt Sensitivity of LLMs
  ☆25Updated last week
• yueqis / API-Based-Agent
  ☆50Updated this week
• oriyor / assistantbench
  Implementation of the paper: "AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?"
  ☆56Updated 5 months ago
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆57Updated 9 months ago
• gangiswag / infogent
  ☆21Updated 3 months ago
• SiliangZeng / Multi-Turn-RL-Agent
  ☆38Updated last week
• allenai / super-benchmark
  ☆42Updated 2 months ago
• mungg / FABLES
  ☆57Updated 8 months ago
• bespokelabsai / verifiers
  Verifiers for LLM Reinforcement Learning
  ☆55Updated last month
• dinobby / MAGDi
  The code implementation of MAGDi: Structured Distillation of Multi-Agent Interaction Graphs Improves Reasoning in Smaller Language Models…
  ☆34Updated last year
• ncsulsj / Robust_Summarization
  ☆9Updated last year
• facebookresearch / DIG-In
  This library supports evaluating disparities in generated image quality, diversity, and consistency between geographic regions.
  ☆20Updated last year
• du-nlp-lab / MLR-Copilot
  ☆65Updated 2 months ago
• OSU-NLP-Group / SeeActChromeExtension
  ☆16Updated 5 months ago
• katiekang1998 / reasoning_generalization
  ☆32Updated 4 months ago
• felixbinder / introspection_self_prediction
  Code for experiments on self-prediction as a way to measure introspection in LLMs
  ☆13Updated 5 months ago
• cyzus / thoughtsculpt
  ☆13Updated 5 months ago
• orionw / promptriever
  The first dense retrieval model that can be prompted like an LM
  ☆73Updated 3 weeks ago
• goncalorafaria / qalign
  QAlign is a new test-time alignment approach that improves language model performance by using Markov chain Monte Carlo methods.
  ☆24Updated last month
• Zhiyuan-Zeng / EvalTree
  [arXiv] EvalTree: Profiling Language Model Weaknesses via Hierarchical Capability Trees
  ☆19Updated 2 months ago
• sail-sg / Rigging-ChatbotArena
  Improving Your Model Ranking on Chatbot Arena by Vote Rigging (ICML 2025)
  ☆21Updated 3 months ago
• SalesforceAIResearch / Elastic-Reasoning
  Make reasoning models scalable
  ☆32Updated this week
• ahans30 / goldfish-loss
  [NeurIPS 2024] Goldfish Loss: Mitigating Memorization in Generative LLMs
  ☆87Updated 6 months ago
• hsaest / Agent-Planning-Analysis
  [NAACL'25] "Revealing the Barriers of Language Agents in Planning"
  ☆12Updated 7 months ago
• ZeroSumEval / ZeroSumEval
  A framework for pitting LLMs against each other in an evolving library of games ⚔
  ☆32Updated last month
• apple / ml-rpm-bench
  ☆41Updated 10 months ago
• zorazrw / agent-skill-induction
  Agent Skill Induction: "Inducing Programmatic Skills for Agentic Tasks"
  ☆20Updated last month