(Model-written) LLM evals library
☆19Dec 13, 2024Updated last year
Alternatives and similar repositories for evalugator
Users that are interested in evalugator are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- we got you bro☆38Jul 29, 2024Updated 2 years ago
- A quick way to get started with Transformer Lens☆14Dec 13, 2023Updated 2 years ago
- ☆14Mar 31, 2024Updated 2 years ago
- Experiments with representation engineering☆14Feb 28, 2024Updated 2 years ago
- Easily deploy my zsh and tmux configuration on new machines. Includes local and remote aliases to improve workflow.☆15Apr 23, 2026Updated 3 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆67Feb 16, 2023Updated 3 years ago
- Situational Awareness Dataset☆53Dec 14, 2024Updated last year
- Measuring the situational awareness of language models☆41Feb 12, 2024Updated 2 years ago
- Pin files for contextual, codebase-level AI assistance.☆16Jul 11, 2024Updated 2 years ago
- Improving Steering Vectors by Targeting Sparse Autoencoder Features☆29Nov 20, 2024Updated last year
- Repository with sample code using Apollo's suggested engineering practices☆15Dec 16, 2024Updated last year
- Methods 2: The General Linear Model☆15May 5, 2022Updated 4 years ago
- METR Task Standard☆188Feb 3, 2025Updated last year
- ☆32Nov 11, 2025Updated 8 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A Dependently Typed Esolang☆10Aug 4, 2017Updated 9 years ago
- ☆15Jul 21, 2023Updated 3 years ago
- Inference API for many LLMs and other useful tools for empirical research☆136May 29, 2026Updated 2 months ago
- A toolbox with the goal of speeding up research on bargaining in MARL (cooperation problems in MARL).☆33Sep 29, 2022Updated 3 years ago
- ☆41Dec 17, 2025Updated 7 months ago
- Proof-carrying code completions in Dafny☆11Apr 4, 2025Updated last year
- Experiments on GPT-3's ability to fit numerical models in-context.☆14Aug 11, 2022Updated 3 years ago
- ☆31May 4, 2023Updated 3 years ago
- Day 2 of Lambda School's Machine Learning Mini Bootcamp☆10Aug 31, 2018Updated 7 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆12Mar 23, 2024Updated 2 years ago
- Python tools for working with Manifold Markets☆41Jul 10, 2026Updated 3 weeks ago
- Estimate costs of complex LLM workflows in advance before spending money☆11Jul 22, 2026Updated 2 weeks ago
- PyTorch and NNsight implementation of AtP* (Kramar et al 2024, DeepMind)☆20Jan 19, 2025Updated last year
- Example fNIRS BIDS dataset☆15Nov 4, 2022Updated 3 years ago
- A python sdk for LLM finetuning and inference on runpod infrastructure☆30May 12, 2026Updated 2 months ago
- Keeping language models honest by directly eliciting knowledge encoded in their activations.☆221Aug 3, 2026Updated last week
- In the interest of transparency and/or their great value to society, I'm releasing my smaller projects/scripts upon an unsuspecting publi…☆10Jul 27, 2026Updated 2 weeks ago
- (WIP) A benchmark to see how well AI agents autonomously make money.☆15Jul 17, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Organize mathematical thoughts☆21Oct 6, 2023Updated 2 years ago
- PyTorch implementation for MRL☆23Feb 22, 2024Updated 2 years ago
- Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).☆268Feb 27, 2026Updated 5 months ago
- Tool for converting LaTeX-prepared documents to Wordpress-ready HTML☆12Mar 11, 2025Updated last year
- Code accompanying the paper "A Language Model's Guide Through Latent Space". It contains functionality for training and using concept vec…☆21Feb 23, 2024Updated 2 years ago
- ☆22Jan 19, 2024Updated 2 years ago
- Tools for studying developmental interpretability in neural networks.☆150Apr 23, 2026Updated 3 months ago