Statistical inference for AI evaluations, from model comparisons to corrections for LLM judge bias, optimized for small sample sizes. All defaults battle-tested in Monte Carlo simulations.
☆131Sep 30, 2026Updated last month
Alternatives and similar repositories for evalstats
Users that are interested in evalstats are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Splat: Affinity diagramming tool in a single HTML file. Cluster notes on a board. Organize data visually. Fully local for privacy. Semant…☆21Dec 31, 2025Updated 10 months ago
- ☆29Nov 8, 2024Updated last year
- ☆50Mar 22, 2026Updated 7 months ago
- ☆21Jul 21, 2026Updated 3 months ago
- Claude Code Skills by Sundial☆153Jul 15, 2026Updated 3 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- This repository contains code for the paper "Better Estimation of the KL Divergence Between Language Models"☆20May 30, 2025Updated last year
- ☆32Mar 11, 2026Updated 7 months ago
- ☆46Mar 9, 2026Updated 7 months ago
- ☆38May 4, 2026Updated 5 months ago
- ☆27Jun 7, 2026Updated 4 months ago
- Fastest du replacement and file tree analysis for 100+GB, million-file worktrees☆17Oct 21, 2026Updated last week
- Demo of knowledge graph creation and Graph RAG with Dspy and Kuzu☆22Jun 30, 2025Updated last year
- AI-powered citation search & paper review for Overleaf — Chrome extension. Think Google Scholar but inside Overleaf. Also works with Open…☆129Jun 13, 2026Updated 4 months ago
- Implementation of Recursive Language Model paper from scratch☆47Feb 10, 2026Updated 8 months ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- [ACL 2024] 💬 MaskLID: Code-Switching Language Identification through Iterative Masking☆13Jun 11, 2024Updated 2 years ago
- Agentic Research and Evaluation Suite☆119Aug 12, 2026Updated 2 months ago
- Code companion for the RL Post-Training Handbook - training reasoning models on a single GPU☆20Jan 30, 2026Updated 9 months ago
- Compiles AI agent traces and truns them into reusable context.☆100Sep 16, 2026Updated last month
- FlashSampling: Fast and Memory-Efficient Exact Sampling (https://huggingface.co/papers/2603.15854)☆90Sep 25, 2026Updated last month
- A collection of lightweight interpretability scripts to understand how LLMs think☆92Mar 18, 2026Updated 7 months ago
- ☆107Feb 27, 2026Updated 8 months ago
- just UI to explain product manager what dspy program does☆27Oct 26, 2025Updated last year
- Identifying amino acids important to AlphaFold!☆11Oct 20, 2026Updated last week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆37Apr 25, 2026Updated 6 months ago
- a fun and educational take on vLLM☆231Jan 25, 2026Updated 9 months ago
- Automatically interact with SVG charts.☆21Sep 23, 2025Updated last year
- Stata syntax highlighting for the listing LaTeX package☆11May 31, 2024Updated 2 years ago
- Personal Quarto Revealjs Template☆12Jun 9, 2026Updated 4 months ago
- Low memory full parameter finetuning of LLMs☆53Jul 18, 2025Updated last year
- A drop-in code interpreter using the Monty Python emulator for DSPy's RLM module.☆56Updated this week
- ☆15Mar 12, 2026Updated 7 months ago
- ☆106Jul 16, 2026Updated 3 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Example of Spin app written in Java using TeaVM-WASI and wit-bindgen☆12Dec 7, 2022Updated 3 years ago
- Async RLVR training that never gives up (with probability p) on hard prompts☆18Oct 7, 2026Updated 3 weeks ago
- Minimal and scalable research codebase in JAX, designed for rapid iteration on frontier research in LLM and other autoregressive models.☆585Oct 24, 2026Updated last week
- Official Repo for InSTA: Towards Internet-Scale Training For Agents☆56Jul 11, 2025Updated last year
- Code repository for "Generative Large Language Models are Poor Medical Coders: A Benchmarking Analysis of Medical Code Querying"☆13Sep 16, 2024Updated 2 years ago
- tooling to support clustermax.ai, the industry standard rating system for neoclouds☆45Updated this week
- Highly-opinionated setup for AI safety research with coding agents☆13Oct 24, 2026Updated last week