Alternatives and similar repositories for TransformerLens:

Users that are interested in TransformerLens are comparing it to the libraries listed below

• jbloomAus / SAELens
  Training Sparse Autoencoders on Language Models
  ☆637Updated this week
• ndif-team / nnsight
  The nnsight package enables interpreting and manipulating the internals of deep learned models.
  ☆503Updated this week
• stanfordnlp / pyvene
  Stanford NLP Python library for understanding and improving PyTorch models via interventions
  ☆706Updated last week
• callummcdougall / ARENA_3.0
  ☆468Updated this week
• andyzoujm / representation-engineering
  Representation Engineering: A Top-Down Approach to AI Transparency
  ☆795Updated 6 months ago
• EleutherAI / sparsify
  Sparsify transformers with SAEs and transcoders
  ☆476Updated this week
• TransformerLensOrg / CircuitsVis
  Mechanistic Interpretability Visualizations using React
  ☆235Updated 2 months ago
• AlignmentResearch / tuned-lens
  Tools for understanding how transformer predictions are built layer-by-layer
  ☆477Updated 9 months ago
• ruizheliUOA / Awesome-Interpretability-in-Large-Language-Models
  This repository collects all relevant resources about interpretability in LLMs
  ☆322Updated 4 months ago
• srush / awesome-o1
  A bibliography and survey of the papers surrounding o1
  ☆1,172Updated 3 months ago
• EleutherAI / cookbook
  Deep learning for dummies. All the practical details and useful utilities that go into working with real models.
  ☆775Updated last week
• openai / sparse_autoencoder
  ☆429Updated 7 months ago
• ContextualAI / HALOs
  A library with extensible implementations of DPO, KTO, PPO, ORPO, and other human-aware loss functions (HALOs).
  ☆808Updated this week
• huggingface / nanotron
  Minimalistic large language model 3D-parallelism training
  ☆1,630Updated this week
• srush / LLM-Training-Puzzles
  What would you do with 1000 H100s...
  ☆1,009Updated last year
• kmeng01 / rome
  Locating and editing factual associations in GPT (NeurIPS 2022)
  ☆603Updated 10 months ago
• ai-safety-foundation / sparse_autoencoder
  Sparse Autoencoder for Mechanistic Interpretability
  ☆217Updated 7 months ago
• callummcdougall / ARENA_2.0
  Resources for skilling up in AI alignment research engineering. Covers basics of deep learning, mechanistic interpretability, and RL.
  ☆207Updated last year
• vec2text / vec2text
  utilities for decoding deep representations (like sentence embeddings) back to text
  ☆769Updated last month
• PiotrNawrot / nanoT5
  Fast & Simple repository for pre-training and fine-tuning T5-style models
  ☆993Updated 6 months ago
• huggingface / search-and-learn
  Recipes to scale inference-time compute of open models
  ☆1,019Updated this week
• HoagyC / sparse_coding
  Using sparse coding to find distributed representations used by neural networks.
  ☆217Updated last year
• huggingface / lighteval
  Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends
  ☆1,238Updated this week
• vgel / repeng
  A library for making RepE control vectors
  ☆552Updated last month
• ArthurConmy / Automatic-Circuit-Discovery
  ☆207Updated 5 months ago
• carlini / yet-another-applied-llm-benchmark
  A benchmark to evaluate language models on questions I've previously asked them to solve.
  ☆976Updated last month
• callummcdougall / sae_vis
  Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).
  ☆183Updated 2 months ago
• jacobhilton / deep_learning_curriculum
  Language model alignment-focused deep learning curriculum
  ☆1,331Updated 6 months ago
• EdinburghNLP / awesome-hallucination-detection
  List of papers on hallucination detection in LLMs.
  ☆785Updated last week
• saprmarks / dictionary_learning
  ☆246Updated 2 weeks ago