UKGovernmentBEIS / inspect_evalsLinks
Collection of evals for Inspect AI
☆264Updated this week
Alternatives and similar repositories for inspect_evals
Users that are interested in inspect_evals are comparing it to the libraries listed below
Sorting:
- METR Task Standard☆163Updated 8 months ago
- ControlArena is a collection of settings, model organisms and protocols - for running control experiments.☆115Updated this week
- Vivaria is METR's tool for running evaluations and conducting agent elicitation research.☆116Updated this week
- ☆113Updated last week
- ☆172Updated this week
- Improving Alignment and Robustness with Circuit Breakers☆238Updated last year
- Open source interpretability artefacts for R1.☆163Updated 6 months ago
- ☆222Updated 7 months ago
- A toolkit for describing model features and intervening on those features to steer behavior.☆209Updated 11 months ago
- Code and results accompanying the paper "Refusal in Language Models Is Mediated by a Single Direction".☆292Updated 4 months ago
- Inference-time scaling for LLMs-as-a-judge.☆304Updated 3 weeks ago
- Contains random samples referenced in the paper "Sleeper Agents: Training Robustly Deceptive LLMs that Persist Through Safety Training".☆120Updated last year
- Red-Teaming Language Models with DSPy☆235Updated 8 months ago
- Inference API for many LLMs and other useful tools for empirical research☆77Updated this week
- ☆304Updated last year
- Run safety benchmarks against AI models and view detailed reports showing how well they performed.☆107Updated this week
- ☆60Updated last month
- Steering vectors for transformer language models in Pytorch / Huggingface☆126Updated 8 months ago
- datasets from the paper "Towards Understanding Sycophancy in Language Models"☆95Updated 2 years ago
- Reproducible, flexible LLM evaluations☆257Updated last week
- Automatic evals for LLMs☆550Updated 4 months ago
- TapeAgents is a framework that facilitates all stages of the LLM Agent development lifecycle☆298Updated last week
- WMDP is a LLM proxy benchmark for hazardous knowledge in bio, cyber, and chemical security. We also release code for RMU, an unlearning m…☆146Updated 4 months ago
- A Collection of Competitive Text-Based Games for Language Model Evaluation and Reinforcement Learning☆300Updated 3 weeks ago
- Persona Vectors: Monitoring and Controlling Character Traits in Language Models☆269Updated 2 months ago
- ☆104Updated last week
- ☆49Updated last year
- [ICLR'24 Spotlight] A language model (LM)-based emulation framework for identifying the risks of LM agents with tool use☆167Updated last year
- ☆142Updated last month
- A Comprehensive Assessment of Trustworthiness in GPT Models☆306Updated last year