Alternatives and similar repositories for VibeCheck

Users that are interested in VibeCheck are comparing it to the libraries listed below

• HazyResearch / aioli
  Aioli: A unified optimization framework for language model data mixing
  ☆28Updated 10 months ago
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆60Updated last year
• para-lost / ReBase
  ReBase: Training Task Experts through Retrieval Based Distillation
  ☆29Updated 9 months ago
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆89Updated last year
• mungg / FABLES
  ☆58Updated last year
• allenai / hybrid-preferences
  Learning to route instances for Human vs AI Feedback (ACL Main '25)
  ☆26Updated 4 months ago
• oriyor / assistantbench
  Implementation of the paper: "AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?"
  ☆66Updated 11 months ago
• facebookresearch / collaborative-reasoner
  Source code for the collaborative reasoner research project at Meta FAIR.
  ☆105Updated 7 months ago
• pgasawa / BARE
  Leveraging Base Language Models for Few-Shot Synthetic Data Generation
  ☆38Updated last month
• salesforce / summary-of-a-haystack
  Codebase accompanying the Summary of a Haystack paper.
  ☆79Updated last year
• allenai / super-benchmark
  ☆49Updated 7 months ago
• allenai / infinigram-api
  ☆82Updated this week
• ZeroSumEval / ZeroSumEval
  A framework for pitting LLMs against each other in an evolving library of games ⚔
  ☆34Updated 7 months ago
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆51Updated 9 months ago
• orionw / promptriever
  The first dense retrieval model that can be prompted like an LM
  ☆89Updated 6 months ago
• felipemaiapolo / tinyBenchmarks
  Evaluating LLMs with fewer examples
  ☆168Updated last year
• KihoPark / LLM_Categorical_Hierarchical_Representations
  ☆111Updated 9 months ago
• SalesforceAIResearch / CRMArena
  Official Repo for CRMArena and CRMArena-Pro
  ☆125Updated 2 weeks ago
• tianyang-x / SaySelf
  Public code repo for paper "SaySelf: Teaching LLMs to Express Confidence with Self-Reflective Rationales"
  ☆109Updated last year
• bespokelabsai / verifiers
  Verifiers for LLM Reinforcement Learning
  ☆79Updated 7 months ago
• r-three / phatgoose
  Code for PHATGOOSE introduced in "Learning to Route Among Specialized Experts for Zero-Shot Generalization"
  ☆91Updated last year
• kanishkg / stream-of-search
  Repository for the paper Stream of Search: Learning to Search in Language
  ☆151Updated 9 months ago
• safety-research / open-source-alignment-faking
  Open Source Replication of Anthropic's Alignment Faking Paper
  ☆51Updated 7 months ago
• princeton-nlp / LitSearch
  [EMNLP 2024] A Retrieval Benchmark for Scientific Literature Search
  ☆101Updated 11 months ago
• microsoft / eureka-ml-insights
  A framework for standardizing evaluations of large foundation models, beyond single-score reporting and rankings.
  ☆171Updated last week
• google-deepmind / latent-multi-hop-reasoning
  [ACL 2024] Do Large Language Models Latently Perform Multi-Hop Reasoning?
  ☆82Updated 8 months ago
• arcee-ai / DAM
  ☆55Updated last year
• TIGER-AI-Lab / StructLM
  Code and data for "StructLM: Towards Building Generalist Models for Structured Knowledge Grounding" (COLM 2024)
  ☆75Updated last year
• OSU-NLP-Group / Middleware
  Middleware for LLMs: Tools Are Instrumental for Language Agents in Complex Environments (EMNLP'2024)
  ☆37Updated 10 months ago
• haizelabs / sphynx
  Sphynx Hallucination Induction
  ☆53Updated 9 months ago