Alternatives and similar repositories for bayes_evals

Users that are interested in bayes_evals are comparing it to the libraries listed below

• Bradley-Butcher / Conformers
  Unofficial implementation of Conformal Language Modeling by Quach et al
  ☆28Updated last year
• MadryLab / platinum-benchmarks
  ☆29Updated 2 months ago
• nikitadhawan / natural
  ☆43Updated 7 months ago
• ltgoslo / bert-in-context
  Official implementation of "BERTs are Generative In-Context Learners"
  ☆28Updated 3 months ago
• mcleish7 / gemstone-scaling-laws
  ☆26Updated 4 months ago
• formll / resolving-scaling-law-discrepancies
  ☆20Updated 11 months ago
• shuoli90 / Rank-Calibration
  This is the repo for constructing a comprehensive and rigorous evaluation framework for LLM calibration.
  ☆13Updated last year
• Networks-Learning / counterfactual-llms
  Code for "Counterfactual Token Generation in Large Language Models", Arxiv 2024.
  ☆26Updated 7 months ago
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆57Updated 9 months ago
• Mayo-Radiology-Informatics-Lab / conflare
  This is the repository for the CONFLARE (CONformal LArge language model REtrieval) Python package.
  ☆19Updated last year
• kristinagligoric / confidence-driven-inference
  ☆12Updated 9 months ago
• IBM / ColPret
  Efficient Scaling laws and collaborative pretraining.
  ☆16Updated 5 months ago
• allenai / infinigram-api
  ☆61Updated 3 weeks ago
• HazyResearch / aioli
  Aioli: A unified optimization framework for language model data mixing
  ☆27Updated 5 months ago
• thestephencasper / everything-you-need
  we got you bro
  ☆35Updated 10 months ago
• vdlad / Remarkable-Robustness-of-LLMs
  Codebase the paper "The Remarkable Robustness of LLMs: Stages of Inference?"
  ☆18Updated 2 weeks ago
• jmerullo / lm_vector_arithmetic
  ☆35Updated 2 years ago
• apoorvkh / academic-pretraining
  $100K or 100 Days: Trade-offs when Pre-Training with Academic Resources
  ☆140Updated last month
• adamkarvonen / SAE_BoardGameEval
  ☆23Updated 4 months ago
• AnswerDotAI / fastkmeans
  ☆61Updated last week
• AndyShih12 / LongHorizonTemperatureScaling
  PyTorch implementation for "Long Horizon Temperature Scaling", ICML 2023
  ☆20Updated 2 years ago
• ConsequentAI / fneval
  Functional Benchmarks and the Reasoning Gap
  ☆87Updated 8 months ago
• ApolloResearch / apd
  Attribution-based Parameter Decomposition
  ☆25Updated 2 weeks ago
• complex-reasoning / RPG
  The official implementation of Regularized Policy Gradient (RPG) (https://arxiv.org/abs/2505.17508)
  ☆35Updated this week
• bhaweshiitk / ConformalLLM
  Extending Conformal Prediction to LLMs
  ☆66Updated last year
• krypticmouse / matryoshka-representation-learning
  PyTorch implementation for MRL
  ☆18Updated last year
• tml-epfl / why-weight-decay
  Why Do We Need Weight Decay in Modern Deep Learning? [NeurIPS 2024]
  ☆66Updated 9 months ago
• tijana-zrnic / cross-ppi
  Cross-prediction-powered inference
  ☆14Updated last year
• epfml / schedules-and-scaling
  Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"
  ☆74Updated 7 months ago
• layer6ai-labs / calo-forest
  A scalable implementation of diffusion and flow-matching with XGBoost models, applied to calorimeter data.
  ☆18Updated 7 months ago