Keeping language models honest by directly eliciting knowledge encoded in their activations.
☆218Apr 27, 2026Updated this week
Alternatives and similar repositories for elk
Users that are interested in elk are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆283Mar 2, 2024Updated 2 years ago
- Erasing concepts from neural representations with provable guarantees☆248Jan 27, 2025Updated last year
- Interpreting how transformers simulate agents performing RL tasks☆90Oct 23, 2023Updated 2 years ago
- Investigating the generalization behavior of LM probes trained to predict truth labels: (1) from one annotator to another, and (2) from e…☆30May 23, 2024Updated last year
- Machine Learning for Alignment Bootcamp☆83Apr 27, 2022Updated 4 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Tools for understanding how transformer predictions are built layer-by-layer☆585Aug 7, 2025Updated 8 months ago
- Code for the ICLR 2024 paper "How to catch an AI liar: Lie detection in black-box LLMs by asking unrelated questions"☆72Jun 19, 2024Updated last year
- A library for mechanistic interpretability of GPT-style language models☆3,357Apr 24, 2026Updated last week
- Code for our paper "Localizing Lying in Llama"☆14Apr 24, 2025Updated last year
- Understanding how features learned by neural networks evolve throughout training☆41Oct 24, 2024Updated last year
- Contains random samples referenced in the paper "Sleeper Agents: Training Robustly Deceptive LLMs that Persist Through Safety Training".☆143Mar 9, 2024Updated 2 years ago
- Measuring the situational awareness of language models☆41Feb 12, 2024Updated 2 years ago
- A dataset of alignment research and code to reproduce it☆78Jun 22, 2023Updated 2 years ago
- ☆20Feb 17, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- (Model-written) LLM evals library☆18Dec 13, 2024Updated last year
- A python sdk for LLM finetuning and inference on runpod infrastructure☆27Apr 23, 2026Updated last week
- Minimum Description Length probing for neural network representations☆20Jan 28, 2025Updated last year
- ☆20Jan 21, 2023Updated 3 years ago
- Vivaria is METR's tool for running evaluations and conducting agent elicitation research.☆136Feb 15, 2026Updated 2 months ago
- ☆280Oct 1, 2024Updated last year
- ☆44Nov 17, 2024Updated last year
- A library for mechanistic anomaly detection☆22Jan 9, 2025Updated last year
- ☆14Jul 12, 2024Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Improving Alignment and Robustness with Circuit Breakers☆261Sep 24, 2024Updated last year
- Sparse Autoencoder for Mechanistic Interpretability☆295Jul 20, 2024Updated last year
- Script for downloading GitHub.☆13Sep 24, 2020Updated 5 years ago
- Utilities for the HuggingFace transformers library☆76Jan 21, 2023Updated 3 years ago
- ☆376Jul 2, 2024Updated last year
- A repository for transformer critique learning and generation☆89Dec 7, 2023Updated 2 years ago
- Redwood Research's transformer interpretability tools☆15Apr 15, 2022Updated 4 years ago
- 📚📚📚📚📚📚📚📚📚 Reading everything☆15Mar 11, 2026Updated last month
- A library for bridging Python and HTML/Javascript (via Svelte) for creating interactive visualizations☆215Dec 22, 2021Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- This is the starter kit for the Trojan Detection Challenge 2023 (LLM Edition), a NeurIPS 2023 competition.☆91May 19, 2024Updated last year
- The nnsight package enables interpreting and manipulating the internals of deep learned models.☆909Updated this week
- Inspect: A framework for large language model evaluations☆1,974Updated this week
- Locating and editing factual associations in GPT (NeurIPS 2022)☆753Apr 20, 2024Updated 2 years ago
- Open source replication of Anthropic's Crosscoders for Model Diffing☆65Oct 27, 2024Updated last year
- Inference-Time Intervention: Eliciting Truthful Answers from a Language Model☆573Jan 28, 2025Updated last year
- ☆58Jun 30, 2023Updated 2 years ago