Alternatives and similar repositories for AttentionLens:

Users that are interested in AttentionLens are comparing it to the libraries listed below

• ckkissane / crosscoder-model-diff-replication
  Open source replication of Anthropic's Crosscoders for Model Diffing
  ☆48Updated 5 months ago
• jbloomAus / SAEDashboard
  ☆33Updated last month
• guy-dar / embedding-space
  ☆54Updated last year
• abhishekpanigrahi1996 / transformer_in_transformer
  ☆45Updated last year
• epfml / schedules-and-scaling
  Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"
  ☆71Updated 5 months ago
• stanfordnlp / axbench
  Stanford NLP Python library for benchmarking the utility of LLM interpretability methods
  ☆62Updated this week
• ApolloResearch / e2e_sae
  Sparse Autoencoder Training Library
  ☆47Updated 5 months ago
• hartvigsen-group / composable-interventions
  ☆27Updated last month
• bilal-chughtai / rep-theory-mech-interp
  ☆26Updated last year
• bartbussmann / matryoshka_sae
  ☆26Updated 2 months ago
• jiahai-feng / binding-iclr
  ☆13Updated last year
• EleutherAI / elk-generalization
  Investigating the generalization behavior of LM probes trained to predict truth labels: (1) from one annotator to another, and (2) from e…
  ☆26Updated 10 months ago
• probabilistic-inference-scaling / probabilistic-inference-scaling
  ☆33Updated last week
• sjelassi / transformers_ssm_copy
  ☆30Updated last year
• KoyenaPal / future-lens
  Code and Data Repo for the CoNLL Paper -- Future Lens: Anticipating Subsequent Tokens from a Single Hidden State
  ☆18Updated last year
• GSYfate / knnlm-limits
  Official code repo for paper "Great Memory, Shallow Reasoning: Limits of kNN-LMs"
  ☆22Updated 7 months ago
• arnab-api / romba
  Applies ROME and MEMIT on Mamba-S4 models
  ☆14Updated 11 months ago
• UFO-101 / auto-circuit
  A library for efficient patching and automatic circuit discovery.
  ☆59Updated last month
• hamishivi / automated-instruction-selection
  Exploration of automated dataset selection approaches at large scales.
  ☆34Updated 3 weeks ago
• mnoukhov / async_rlhf
  Code and Configs for Asynchronous RLHF: Faster and More Efficient RL for Language Models
  ☆38Updated this week
• formll / resolving-scaling-law-discrepancies
  ☆18Updated 8 months ago
• princeton-nlp / Edge-Pruning
  [NeurIPS 2024 Spotlight] Code and data for the paper "Finding Transformer Circuits with Edge Pruning".
  ☆47Updated 3 weeks ago
• Nix07 / finetuning
  This repository contains the code used for the experiments in the paper "Fine-Tuning Enhances Existing Mechanisms: A Case Study on Entity…
  ☆25Updated last year
• Doraemonzzz / xmixers
  Xmixers: A collection of SOTA efficient token/channel mixers
  ☆11Updated 4 months ago
• saprmarks / geometry-of-truth
  ☆82Updated 7 months ago
• prateeky2806 / ComPEFT
  ☆25Updated last year
• nathanhu0 / CaMeLS
  Codebase for Context-aware Meta-learned Loss Scaling (CaMeLS). https://arxiv.org/abs/2305.15076.
  ☆25Updated last year
• mlfoundations / scaling
  Language models scale reliably with over-training and on downstream tasks
  ☆96Updated 11 months ago
• PKU-ML / LongPPL
  Code for ICLR 2025 Paper "What is Wrong with Perplexity for Long-context Language Modeling?"
  ☆44Updated this week
• sfeucht / footprints
  https://footprints.baulab.info
  ☆17Updated 5 months ago