Phylliida / MambaLens
Mamba support for transformer lens
☆14Updated 5 months ago
Alternatives and similar repositories for MambaLens:
Users that are interested in MambaLens are comparing it to the libraries listed below
- ☆51Updated 9 months ago
- Investigating the generalization behavior of LM probes trained to predict truth labels: (1) from one annotator to another, and (2) from e…☆26Updated 8 months ago
- ☆47Updated last year
- A library for efficient patching and automatic circuit discovery.☆53Updated this week
- ☆58Updated 9 months ago
- ☆27Updated 3 months ago
- A library for mechanistic anomaly detection☆19Updated last month
- Sparse Autoencoder Training Library☆41Updated 3 months ago
- ☆46Updated last year
- ☆30Updated 11 months ago
- Stick-breaking attention☆43Updated last month
- ☆12Updated 11 months ago
- ☆55Updated 3 months ago
- Code for reproducing our paper "Not All Language Model Features Are Linear"☆68Updated 2 months ago
- Official code repo for paper "Great Memory, Shallow Reasoning: Limits of kNN-LMs"☆21Updated 5 months ago
- This repository contains the code used for the experiments in the paper "Fine-Tuning Enhances Existing Mechanisms: A Case Study on Entity…☆23Updated 11 months ago
- Official implementation of the transformer (TF) architecture suggested in a paper entitled "Looped Transformers as Programmable Computers…☆24Updated last year
- Universal Neurons in GPT2 Language Models☆27Updated 8 months ago
- ☆71Updated 6 months ago
- Open source replication of Anthropic's Crosscoders for Model Diffing☆39Updated 3 months ago
- ☆151Updated this week
- PyTorch and NNsight implementation of AtP* (Kramar et al 2024, DeepMind)☆18Updated last month
- Multi-Layer Sparse Autoencoders (ICLR 2025)☆18Updated last week
- ☆76Updated 6 months ago
- The repository contains code for Adaptive Data Optimization☆20Updated 2 months ago
- Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"☆25Updated 10 months ago
- Custom triton kernels for training Karpathy's nanoGPT.☆16Updated 4 months ago
- Simple and efficient pytorch-native transformer training and inference (batched)☆68Updated 10 months ago
- Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"☆70Updated 3 months ago