Mechanistic Interpretability in Transformers: This repository explores advanced techniques like Induction Head Detection and QK Circuit Analysis to uncover the inner workings of transformer-based models.
☆38Sep 27, 2024Updated last year
Alternatives and similar repositories for Mechanistic-Interpretability
Users that are interested in Mechanistic-Interpretability are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A tiny easily hackable implementation of a feature dashboard.☆17Oct 21, 2025Updated 10 months ago
- 🧠 Starter templates for doing interpretability research☆78Jul 16, 2023Updated 3 years ago
- ☆265Nov 22, 2024Updated last year
- Deepseek-CoT☆10Oct 6, 2024Updated last year
- Code for "The Geometry of Concepts: Sparse Autoencoder Feature Structure"☆17Mar 25, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆14Jan 10, 2021Updated 5 years ago
- This is sample code for Paho MQTT server with Python 2.7☆10Mar 29, 2016Updated 10 years ago
- trio async MQTT client that wraps paho-mqtt☆12Feb 8, 2021Updated 5 years ago
- A Qwen .5B reasoning model trained on OpenR1-Math-220k☆14Updated this week
- Abstraction and Reasoning Corpus☆15Nov 22, 2022Updated 3 years ago
- ☆18Nov 11, 2022Updated 3 years ago
- Lab Cookbook☆42Aug 5, 2026Updated 3 weeks ago
- Data Wrangling, Linear Models & other misc. Inferential Statistics.☆14Jul 16, 2022Updated 4 years ago
- FeatureAlignment = Alignment + Mechanistic Interpretability☆35Mar 8, 2025Updated last year
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- web-crawling (with AngleSharp)☆12May 26, 2025Updated last year
- The Process Extraction and Analysis Tool (PEAT), a Operational Technology (OT) device data collection tool☆28Updated this week
- Approximating the joint distribution of language models via MCTS☆22Nov 3, 2024Updated last year
- Global CoT Analysis: Initial attempts to uncover patterns across many chains of thought☆20Feb 10, 2026Updated 6 months ago
- Bridge Python and TypeScript with ease. Use simple decorators to expose Python functions, methods, and classes to TypeScript with full ty…☆23Mar 7, 2025Updated last year
- Evaluating Durability: Benchmark Insights into Multimodal Watermarking☆12Jun 7, 2024Updated 2 years ago
- Multi-Layer Sparse Autoencoders (ICLR 2025)☆30Feb 6, 2026Updated 6 months ago
- Entropy Based Sampling and Parallel CoT Decoding☆17Oct 9, 2024Updated last year
- a bunch of rubrics I made in different format and structure for llm judge and other use cases☆16Sep 22, 2025Updated 11 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- The open-source materials for paper "Sparsing Law: Towards Large Language Models with Greater Activation Sparsity".☆32Nov 12, 2024Updated last year
- The E-UNet is a powerful architecture for real-time semantic segmentation, especially if one wants to run it in low-resource embedded sys…☆10Dec 31, 2020Updated 5 years ago
- Implementation of the algorithm detailed in paper "Evolutionary design of molecules based on deep learning and a genetic algorithm"☆24Dec 15, 2023Updated 2 years ago
- Paho MQTT client supporting asyncio loop without additional setup.☆18Jan 13, 2023Updated 3 years ago
- ☆12Jun 15, 2023Updated 3 years ago
- train entropix like a champ!☆20Oct 10, 2024Updated last year
- Slides for the System Design series sessions.☆12Aug 31, 2022Updated 3 years ago
- 一个gin+vue的前后端分离项目,如果有帮助到您关于gin的学习,可以打赏一杯咖啡~☆13Nov 6, 2020Updated 5 years ago
- Detecting and extracting information in forms where checkboxes are present☆15Jul 11, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- subTee gists code backups☆37Dec 19, 2017Updated 8 years ago
- ☆17May 6, 2025Updated last year
- A novel approach for transformer model introspection that enables saving, compressing, and manipulating internal thought states for advan…☆34Mar 22, 2026Updated 5 months ago
- Graphical rewriting for diagrammatic reasoning in monoidal categories in Lean4☆32Jun 27, 2024Updated 2 years ago
- Really quick-and-dirty example of AI recursive learning☆32Nov 8, 2024Updated last year
- 在监控画质下实现对校园自行车的重识别，包含REID模型识别，向量数据库检索，UI展示☆11Feb 13, 2024Updated 2 years ago
- Measuring the Mixing of Contextual Information in the Transformer☆35May 27, 2023Updated 3 years ago