Every Eval Ever is a shared schema and crowdsourced eval database. It defines a standardized metadata format for storing AI evaluation results — from leaderboard scrapes and research papers to local evaluation runs — so that results from different frameworks can be compared, reproduced, and reused.
☆66May 14, 2026Updated last week
Alternatives and similar repositories for every_eval_ever
Users that are interested in every_eval_ever are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- James' cookbook of evaluations and finetuning experiments☆27Feb 19, 2026Updated 3 months ago
- Forcing Diffuse Distributions out of Language Models☆18Sep 10, 2024Updated last year
- An official PyTorch implementation for CLIPPR☆31Jul 22, 2023Updated 2 years ago
- $100K or 100 Days: Trade-offs when Pre-Training with Academic Resources☆152Oct 2, 2025Updated 7 months ago
- Generate synthetic labeled data for extremely low-resource languages using bilingual lexicons.☆20Oct 3, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Crosslingual Reasoning through Test-Time Scaling☆19May 13, 2025Updated last year
- Build a Docker container to build, train and deploy fast.ai based Deep Learning models with Amazon SageMaker☆13Dec 15, 2018Updated 7 years ago
- official code for paper Probing the Decision Boundaries of In-context Learning in Large Language Models. https://arxiv.org/abs/2406.11233…☆20Jul 27, 2025Updated 9 months ago
- Repository for "Attribute First, then Generate: Locally-attributable Grounded Text Generation", ACL 2024☆30Dec 19, 2024Updated last year
- ☆11Oct 3, 2021Updated 4 years ago
- ☆22Jul 16, 2024Updated last year
- 모두의 말뭉치 데이터를 분석에 편리한 형태로 변환하는 기능을 제공합니다.☆11Mar 2, 2022Updated 4 years ago
- A curated reading list of research in Sparse Autoencoders, Feature Extraction and related topics in Mechanistic Interpretability☆32Jan 30, 2025Updated last year
- The official repo for "CodeScaler: Scaling Code LLM Training and Test-Time Inference via Execution-Free Reward Models"☆33Mar 26, 2026Updated last month
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- This was designed for interp researchers who want to do research on or with interp agents to give quality of life improvements and fix …☆145Feb 8, 2026Updated 3 months ago
- MetricEval: A framework that conceptualizes and operationalizes four main components of metric evaluation, in terms of reliability and va…☆12Nov 6, 2023Updated 2 years ago
- Auditing agents for fine-tuning safety☆21Oct 21, 2025Updated 7 months ago
- The AI that helps you achieve your goals☆11Feb 4, 2024Updated 2 years ago
- Blindspots in LLMs I've noticed while AI coding. Sonnet family emphasis.☆13Mar 20, 2025Updated last year
- ☆15Mar 3, 2022Updated 4 years ago
- ☆14Jan 21, 2025Updated last year
- Automated terminal emulator benchmarks☆23May 1, 2026Updated 2 weeks ago
- ☆10Nov 1, 2022Updated 3 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Sparsify transformers with cross-layer transcoders☆23Nov 14, 2025Updated 6 months ago
- Fast Image Integrity Checker: Scan for corrupted images using Nvidia DALI☆22Jun 20, 2021Updated 4 years ago
- ☆10Nov 8, 2022Updated 3 years ago
- Customizable charts made with TikZ and LaTeX3☆14Feb 11, 2023Updated 3 years ago
- Universe website☆10Mar 3, 2023Updated 3 years ago
- An analog touch screen joystick that pretends to be a bevy gamepad☆13Jul 13, 2024Updated last year
- Generative Agent simulation of a Mastodon social network☆26May 7, 2026Updated 2 weeks ago
- ☆14Jul 7, 2024Updated last year
- ASSIST: Towards Label Noise-Robust Dialogue State Tracking☆10Apr 11, 2022Updated 4 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ICLR 2025 Workshop & CHI 2025 SIG: "Bidirectional Human-AI Alignment"☆54Aug 6, 2024Updated last year
- ☆30Jul 2, 2025Updated 10 months ago
- ☆54Apr 7, 2026Updated last month
- AgentIR is a retriever specialized for Deep Research agents.☆56Apr 16, 2026Updated last month
- Code to reproduce key results accompanying "SAEs (usually) Transfer Between Base and Chat Models"☆13Jul 18, 2024Updated last year
- Saving Dense Retriever from Shortcut Dependency in Conversational Search (EMNLP 2022)☆18Nov 24, 2022Updated 3 years ago
- Code repo for the model organisms and convergent directions of EM papers.☆64Sep 22, 2025Updated 7 months ago