Statistical analysis for LLM evaluations, from model and prompt comparisons to inference resilient to LLM judge bias, including at small sample sizes. All defaults battle-tested in Monte Carlo simulations.
☆114Aug 9, 2026Updated this week
Alternatives and similar repositories for evalstats
Users that are interested in evalstats are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Splat: Affinity diagramming tool in a single HTML file. Cluster notes on a board. Organize data visually. Fully local for privacy. Semant…☆21Dec 31, 2025Updated 7 months ago
- A projectional editor for JSON DSLs☆29Mar 30, 2024Updated 2 years ago
- FlashSampling: Fast and Memory-Efficient Exact Sampling (https://huggingface.co/papers/2603.15854)☆86Updated this week
- ☆48Mar 22, 2026Updated 4 months ago
- Low memory full parameter finetuning of LLMs☆54Jul 18, 2025Updated last year
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- ☆27Jun 7, 2026Updated 2 months ago
- Dataset: BuzzFeed News “Trending” Strip, 2018–2023☆18May 24, 2023Updated 3 years ago
- ☆30Nov 8, 2024Updated last year
- The official repo for DARG: Dynamic Evaluation of Large Language Models via Adaptive Reasoning Graph☆18Oct 13, 2024Updated last year
- Meta-Reinforcement Learning with Self-Reflection☆33Mar 26, 2026Updated 4 months ago
- Long read to reference genome mapping tool☆13Mar 14, 2024Updated 2 years ago
- Notebooks and other course materials for Emory QTM 340 (Fall 2022)☆12Dec 13, 2022Updated 3 years ago
- Automatically interact with SVG charts.☆20Sep 23, 2025Updated 10 months ago
- Replication Resources (code+data) for "Causal Claims in Economics" by Garg P. and Fetzer T. (2026)☆28Mar 11, 2026Updated 4 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆36Apr 25, 2026Updated 3 months ago
- A collection of lightweight interpretability scripts to understand how LLMs think☆91Mar 18, 2026Updated 4 months ago
- TEVO: evolve LM motifs cheaply, then validate them in downstream train.py loops.☆19Apr 18, 2026Updated 3 months ago
- ☆15Dec 8, 2022Updated 3 years ago
- Module to determine where repeats are and make soft-masks of said☆10Mar 14, 2024Updated 2 years ago
- ☆30Apr 26, 2026Updated 3 months ago
- Decennial and Intercensal Estimates of US Population by Age and Sex 1990-2019☆10Apr 12, 2020Updated 6 years ago
- Agentic Research and Evaluation Suite☆110Updated this week
- ☆105Jul 16, 2026Updated 3 weeks ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆16Jun 3, 2025Updated last year
- 📊 🌐 🧑🏫 Website for graduate-level course on program evaluation and causal inference using R, built with Quarto☆10Jul 30, 2024Updated 2 years ago
- Programmatic memory for long-horizon LLM agents: the harness appends everything to one log, and the agent searches it with code. 97.4% on…☆297Updated this week
- ☆11Mar 11, 2026Updated 5 months ago
- OLMost every training recipe you need to perform data interventions with the OLMo family of models.☆74Jul 21, 2026Updated 2 weeks ago
- ☆32Mar 11, 2026Updated 4 months ago
- ☆18Jun 7, 2023Updated 3 years ago
- Structured close reading (or rather, close watching) transcripts of _almost _ every lesson in Jeremy Howard's Practical Deep Learning for…☆35Mar 9, 2026Updated 5 months ago
- Official repository of the paper MPMQA: Multimodal Question Answering on Product Manuals (AAAI 2023)☆21Nov 28, 2022Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Inference API for many LLMs and other useful tools for empirical research☆136May 29, 2026Updated 2 months ago
- Stata syntax highlighting for the listing LaTeX package☆11May 31, 2024Updated 2 years ago
- Miscellaneous Stata Commands☆13May 23, 2023Updated 3 years ago
- Quarto template for Onyxia presentations☆33Jun 20, 2025Updated last year
- AI-Powered Thesis Review Tool☆17Aug 8, 2025Updated last year
- Compiles AI agent traces and truns them into reusable context.☆97Jul 28, 2026Updated 2 weeks ago
- context-efficient terminal agent powered by an RLM☆60Feb 7, 2026Updated 6 months ago