Alternatives and similar repositories for modelcomponents

Users that are interested in modelcomponents are comparing it to the libraries listed below

• goombalab / phi-mamba
  Official implementation of Phi-Mamba. A MOHAWK-distilled model (Transformers to SSMs: Distilling Quadratic Knowledge to Subquadratic Mode…
  ☆108Updated 9 months ago
• EvolvingLMMs-Lab / multimodal-sae
  Auto Interpretation Pipeline and many other functionalities for Multimodal SAE Analysis.
  ☆137Updated 5 months ago
• AmeenAli / HiddenMambaAttn
  Official PyTorch Implementation of "The Hidden Attention of Mamba Models"
  ☆223Updated last year
• multimodal-interpretability / maia
  Official implementation of MAIA, A Multimodal Automated Interpretability Agent
  ☆82Updated this week
• uclaml / MoE
  Towards Understanding the Mixture-of-Experts Layer in Deep Learning
  ☆31Updated last year
• jxiw / MambaInLlama
  [NeurIPS 2024] Official Repository of The Mamba in the Llama: Distilling and Accelerating Hybrid Models
  ☆221Updated last month
• zitian-gao / one-shot-em
  One-shot Entropy Minimization
  ☆149Updated 2 weeks ago
• JoshEngels / MultiDimensionalFeatures
  Code for reproducing our paper "Not All Language Model Features Are Linear"
  ☆75Updated 6 months ago
• csinva / interpretable-embeddings
  Interpretable text embeddings by asking LLMs yes/no questions (NeurIPS 2024)
  ☆37Updated 7 months ago
• prateeky2806 / ties-merging
  ☆183Updated last year
• Luckfort / CD
  [COLING'25] Exploring Concept Depth: How Large Language Models Acquire Knowledge at Different Layers?
  ☆79Updated 5 months ago
• shuyhere / Awesome-Sparse-Autoencoder
  Collection of Reverse Engineering in Large Model
  ☆32Updated 5 months ago
• HKUNLP / diffusion-of-thoughts
  [NeurIPS 2024] Code for the paper "Diffusion of Thoughts: Chain-of-Thought Reasoning in Diffusion Language Models"
  ☆160Updated 3 months ago
• stanfordnlp / axbench
  Stanford NLP Python library for benchmarking the utility of LLM interpretability methods
  ☆95Updated 3 weeks ago
• ycjing / Awesome-Model-Merging
  A curated list of Model Merging methods.
  ☆92Updated 9 months ago
• peterljq / Parsimonious-Concept-Engineering
  PaCE: Parsimonious Concept Engineering for Large Language Models (NeurIPS 2024)
  ☆37Updated 7 months ago
• test-time-training / ttt-lm-kernels
  Inference Speed Benchmark for Learning to (Learn at Test Time): RNNs with Expressive Hidden States
  ☆67Updated 11 months ago
• koayon / awesome-adaptive-computation
  A curated reading list of research in Adaptive Computation, Inference-Time Computation & Mixture of Experts (MoE).
  ☆147Updated 5 months ago
• jacobdunefsky / transcoder_circuits
  ☆131Updated 7 months ago
• g-luo / vlm_cross_modal_reps
  Official PyTorch Implementation for Vision-Language Models Create Cross-Modal Task Representations, ICML 2025
  ☆27Updated last month
• Leiay / looped_transformer
  ☆28Updated last year
• KihoPark / linear_rep_geometry
  ☆95Updated 4 months ago
• lucidrains / coconut-pytorch
  Implementation of 🥥 Coconut, Chain of Continuous Thought, in Pytorch
  ☆175Updated this week
• locuslab / massive-activations
  Code accompanying the paper "Massive Activations in Large Language Models"
  ☆163Updated last year
• waltonfuture / Diff-eRank
  [NeurIPS 2024] A Novel Rank-Based Metric for Evaluating Large Language Models
  ☆46Updated 3 weeks ago
• mcleish7 / arithmetic
  Code to reproduce "Transformers Can Do Arithmetic with the Right Embeddings", McLeish et al (NeurIPS 2024)
  ☆190Updated last year
• EleutherAI / delphi
  Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …
  ☆185Updated last week
• HoagyC / sparse_coding
  Using sparse coding to find distributed representations used by neural networks.
  ☆255Updated last year
• Prisma-Multimodal / ViT-Prisma
  ViT Prisma is a mechanistic interpretability library for Vision and Video Transformers (ViTs).
  ☆275Updated 2 weeks ago
• YefanZhou / TempBalance
  [NeurIPS 2023 Spotlight] Temperature Balancing, Layer-wise Weight Analysis, and Neural Network Training
  ☆35Updated 2 months ago