A lightweight library for Bayesian analysis of LLM evals (ICML 2025 Spotlight Position Paper)
☆25May 28, 2025Updated last year
Alternatives and similar repositories for bayes_evals
Users that are interested in bayes_evals are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Portfolio REgret for Confidence SEquences☆21Jan 6, 2026Updated 9 months ago
- Implicit Deep Adaptive Design (iDAD): Policy-Based Experimental Design without Likelihoods☆26Dec 30, 2021Updated 4 years ago
- [ACL 2025 Main] Official Repository for "Evaluating Language Models as Synthetic Data Generators"☆42Dec 13, 2024Updated last year
- ☆15Aug 14, 2025Updated last year
- ☆10Feb 9, 2026Updated 8 months ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- An R package for simulating line lists☆11Sep 7, 2026Updated last month
- Programming in Psychological Science course. This repository contains materials for a R + Python intro course.☆17May 3, 2023Updated 3 years ago
- ☆10Oct 11, 2022Updated 3 years ago
- Amortized Monte Carlo Integration☆15Jun 17, 2020Updated 6 years ago
- Course materials for PSYCH101-D. "Data Science for Research Psychology"☆12Apr 6, 2022Updated 4 years ago
- A manuscript exploring the effects of taxonomic bias on microbiome differential-abundance analysis.☆12Oct 30, 2023Updated 2 years ago
- ☆10Sep 30, 2025Updated last year
- ☆10Aug 26, 2022Updated 4 years ago
- Jupyter notebooks from our weekly (or so) hackathons☆11Dec 3, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Code for "Exponential Family Estimation via Adversarial Dynamics Embedding" (NeurIPS 2019)☆14Nov 26, 2019Updated 6 years ago
- Neuroproc dataset descriptions and dictionaries☆17Jan 2, 2017Updated 9 years ago
- Source code for ASRU 2019 paper "Adapting Pretrained Transformer to Lattices for Spoken Language Understanding"☆10Jul 8, 2020Updated 6 years ago
- Reverse engineering of Metacognition toolbox☆19Aug 19, 2026Updated last month
- Examples on INLA within MCMC☆12May 15, 2017Updated 9 years ago
- ☆12Nov 22, 2022Updated 3 years ago
- ☆16Apr 26, 2023Updated 3 years ago
- Code accompanying VarGrad: A Low-Variance Gradient Estimator for Variational Inference☆12Oct 12, 2020Updated 5 years ago
- Source code for "Unsupervised Lexicon Discovery from Acoustic Input ", Lee et al, 2015 TACL☆10Aug 11, 2016Updated 10 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- A Declarative Language for Expressing Partial World Knowledge to Reinforcement Learning Agents☆17Jan 19, 2024Updated 2 years ago
- Stata module for fast wild bootstrap-based inference. Releases posted here are appropriate for use, and are usually posted promptly on SS…☆13Jun 5, 2026Updated 4 months ago
- This is a read-only mirror of the CRAN R package repository. colorspace — A Toolbox for Manipulating and Assessing Colors and Palettes.…☆12Jul 12, 2026Updated 2 months ago
- Train neural networks to use as SMC and importance sampling proposals☆24Dec 6, 2017Updated 8 years ago
- Implementing the OPRO paper☆17Sep 18, 2023Updated 3 years ago
- Code and dataset for Polyglot Prompting: Multilingual Multitask Prompt Training.☆18Dec 7, 2022Updated 3 years ago
- Posterior with interesting shapes from actually used models☆13Feb 10, 2025Updated last year
- Code for the "Long Context Needs Some R&R" paper.☆12Mar 11, 2024Updated 2 years ago
- ☆12Oct 21, 2017Updated 8 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Course materials for 11-767☆14Nov 10, 2022Updated 3 years ago
- ☆13Mar 10, 2026Updated 7 months ago
- Utility provides a more meaningful measure of forecast skill than goodness-of-fit☆18Apr 26, 2022Updated 4 years ago
- Bayesian active learning with EPIG data acquisition☆42Sep 4, 2025Updated last year
- A simple R package for calculating (meta-) SDT measures☆19Feb 5, 2024Updated 2 years ago
- PyTorch utilities for ML, specifically speech☆13Jan 30, 2024Updated 2 years ago
- Python Model Builder - fit statistical models using algorithmic differentiation☆14Mar 7, 2019Updated 7 years ago