collin-burns / discovering_latent_knowledgeView external linksLinks
☆284Mar 2, 2024Updated last year
Alternatives and similar repositories for discovering_latent_knowledge
Users that are interested in discovering_latent_knowledge are comparing it to the libraries listed below
Sorting:
- Keeping language models honest by directly eliciting knowledge encoded in their activations.☆217Jan 26, 2026Updated 2 weeks ago
- Tools for understanding how transformer predictions are built layer-by-layer☆567Aug 7, 2025Updated 6 months ago
- Inference-Time Intervention: Eliciting Truthful Answers from a Language Model☆570Jan 28, 2025Updated last year
- Erasing concepts from neural representations with provable guarantees☆243Jan 27, 2025Updated last year
- ☆58Jun 30, 2023Updated 2 years ago
- ☆116Feb 11, 2025Updated last year
- Utilities for the HuggingFace transformers library☆74Jan 21, 2023Updated 3 years ago
- A library for mechanistic interpretability of GPT-style language models☆3,073Updated this week
- Code for the ICLR 2024 paper "How to catch an AI liar: Lie detection in black-box LLMs by asking unrelated questions"☆71Jun 19, 2024Updated last year
- Contains random samples referenced in the paper "Sleeper Agents: Training Robustly Deceptive LLMs that Persist Through Safety Training".☆127Mar 9, 2024Updated last year
- Official codebase for "Analyzing the Generalization and Reliability of Steering Vectors"☆19Dec 14, 2024Updated last year
- Evaluate interpretability methods on localizing and disentangling concepts in LLMs.☆57Oct 30, 2025Updated 3 months ago
- ☆60Mar 9, 2023Updated 2 years ago
- Representation Engineering: A Top-Down Approach to AI Transparency☆947Aug 14, 2024Updated last year
- Locating and editing factual associations in GPT (NeurIPS 2022)☆724Apr 20, 2024Updated last year
- Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).☆240Dec 16, 2024Updated last year
- ☆12Oct 23, 2022Updated 3 years ago
- Sparse Autoencoder for Mechanistic Interpretability☆291Jul 20, 2024Updated last year
- ☆551Feb 5, 2024Updated 2 years ago
- Code release for "Debating with More Persuasive LLMs Leads to More Truthful Answers"☆124Mar 22, 2024Updated last year
- Co-Supervised Learning: Improving Weak-to-Strong Generalization with Hierarchical Mixture of Experts☆16Feb 26, 2024Updated last year
- ☆329Jul 2, 2024Updated last year
- Steering Llama 2 with Contrastive Activation Addition☆209May 23, 2024Updated last year
- PAIR.withgoogle.com and friend's work on interpretability methods☆220Feb 4, 2026Updated last week
- ☆1,069Mar 6, 2024Updated last year
- [JMLR] TRADES + random smoothing for certifiable robustness☆14Sep 13, 2020Updated 5 years ago
- ☆38Oct 3, 2023Updated 2 years ago
- ☆68May 18, 2023Updated 2 years ago
- Finding trojans in aligned LLMs. Official repository for the competition hosted at SaTML 2024.☆116Jun 13, 2024Updated last year
- ☆96Oct 27, 2022Updated 3 years ago
- Code repo for the model organisms and convergent directions of EM papers.☆49Sep 22, 2025Updated 4 months ago
- ☆570Jul 19, 2024Updated last year
- Code release for "TempLM: Distilling Language Models into Template-Based Generators"☆14Jul 21, 2022Updated 3 years ago
- Fast Axiomatic Attribution for Neural Networks (NeurIPS*2021)☆16May 12, 2023Updated 2 years ago
- PyTorch-based library for various kinds of representational-similarity analysis☆24Jun 7, 2024Updated last year
- Investigating the generalization behavior of LM probes trained to predict truth labels: (1) from one annotator to another, and (2) from e…☆28May 23, 2024Updated last year
- [ICLR 2023] PyTorch code of Summarization Programs: Interpretable Abstractive Summarization with Neural Modular Trees☆24Jun 19, 2023Updated 2 years ago
- Using sparse coding to find distributed representations used by neural networks.☆296Nov 10, 2023Updated 2 years ago
- ☆146Jul 23, 2025Updated 6 months ago