(Model-written) LLM evals library
☆19Dec 13, 2024Updated last year
Alternatives and similar repositories for evalugator
Users that are interested in evalugator are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- we got you bro☆39Jul 29, 2024Updated 2 years ago
- A quick way to get started with Transformer Lens☆15Dec 13, 2023Updated 2 years ago
- ☆14Mar 31, 2024Updated 2 years ago
- Experiments with representation engineering☆14Feb 28, 2024Updated 2 years ago
- ☆32Apr 4, 2024Updated 2 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- The Happy Faces Benchmark☆15Jul 20, 2023Updated 3 years ago
- ☆60Mar 8, 2022Updated 4 years ago
- Easily deploy my zsh and tmux configuration on new machines. Includes local and remote aliases to improve workflow.☆16Apr 23, 2026Updated 5 months ago
- ☆68Feb 16, 2023Updated 3 years ago
- Archive of questions from the Cambridge Mathematics Tripos☆10Jun 6, 2022Updated 4 years ago
- Situational Awareness Dataset☆56Dec 14, 2024Updated last year
- Machine Learning for Alignment Bootcamp☆87Updated this week
- Apps that run on modal.com☆13Sep 14, 2025Updated last year
- Pin files for contextual, codebase-level AI assistance.☆16Jul 11, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Improving Steering Vectors by Targeting Sparse Autoencoder Features☆30Nov 20, 2024Updated last year
- METR Task Standard☆197Feb 3, 2025Updated last year
- Repo for the paper on Escalation Risks of AI systems☆45Apr 12, 2024Updated 2 years ago
- ☆33Nov 11, 2025Updated 10 months ago
- Inference API for many LLMs and other useful tools for empirical research☆136May 29, 2026Updated 4 months ago
- A toolbox with the goal of speeding up research on bargaining in MARL (cooperation problems in MARL).☆33Sep 29, 2022Updated 4 years ago
- ☆41Dec 17, 2025Updated 9 months ago
- Experiments on GPT-3's ability to fit numerical models in-context.☆14Aug 11, 2022Updated 4 years ago
- ☆14Jul 24, 2021Updated 5 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆31May 4, 2023Updated 3 years ago
- Day 2 of Lambda School's Machine Learning Mini Bootcamp☆10Aug 31, 2018Updated 8 years ago
- ☆12Mar 23, 2024Updated 2 years ago
- Nix + Lean = Nale☆12Jul 16, 2023Updated 3 years ago
- Estimate costs of complex LLM workflows in advance before spending money☆11Jul 22, 2026Updated 2 months ago
- Can Large Language Models Solve Security Challenges? We test LLMs' ability to interact and break out of shell environments using the Over…☆13Aug 21, 2023Updated 3 years ago
- PyTorch and NNsight implementation of AtP* (Kramar et al 2024, DeepMind)☆21Jan 19, 2025Updated last year
- Example fNIRS BIDS dataset☆15Nov 4, 2022Updated 3 years ago
- A python sdk for LLM finetuning and inference on runpod infrastructure☆30Updated this week
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- ☆16Feb 24, 2022Updated 4 years ago
- Keeping language models honest by directly eliciting knowledge encoded in their activations.☆225Sep 28, 2026Updated last week
- 🔥 A repository for collecting cyberdefense thoughts, books, and documents about AI cyberdefense☆13Jul 2, 2023Updated 3 years ago
- (WIP) A benchmark to see how well AI agents autonomously make money.☆15Jul 17, 2025Updated last year
- Organize mathematical thoughts☆21Oct 6, 2023Updated 3 years ago
- PyTorch implementation for MRL☆23Feb 22, 2024Updated 2 years ago
- ☆11Oct 1, 2025Updated last year