Alternatives and similar repositories for modelcomponents

Users that are interested in modelcomponents are comparing it to the libraries listed below

• multimodal-interpretability / maia
  Official implementation of MAIA, A Multimodal Automated Interpretability Agent
  ☆102Updated 2 months ago
• g-luo / vlm_cross_modal_reps
  Official PyTorch Implementation for Vision-Language Models Create Cross-Modal Task Representations, ICML 2025
  ☆31Updated 8 months ago
• oripress / EntropyEnigma
  Official code for the ICML 2024 paper "The Entropy Enigma: Success and Failure of Entropy Minimization"
  ☆55Updated last year
• goombalab / phi-mamba
  Official implementation of Phi-Mamba. A MOHAWK-distilled model (Transformers to SSMs: Distilling Quadratic Knowledge to Subquadratic Mode…
  ☆119Updated last year
• katiekang1998 / reasoning_generalization
  ☆33Updated last year
• AmeenAli / HiddenMambaAttn
  Official PyTorch Implementation of "The Hidden Attention of Mamba Models"
  ☆231Updated 3 months ago
• jonhue / activeft
  PyTorch library for Active Fine-Tuning
  ☆96Updated 3 months ago
• lucidrains / coconut-pytorch
  Implementation of 🥥 Coconut, Chain of Continuous Thought, in Pytorch
  ☆181Updated 6 months ago
• neilwen987 / CSR_Adaptive_Rep
  Official Code for Paper: Beyond Matryoshka: Revisiting Sparse Coding for Adaptive Representation
  ☆132Updated last week
• abdelwahed / OT_for_big_data
  Optimal Transport in the Big Data Era
  ☆115Updated last year
• jxiw / MambaInLlama
  [NeurIPS 2024] Official Repository of The Mamba in the Llama: Distilling and Accelerating Hybrid Models
  ☆234Updated 3 months ago
• taufeeque9 / codebook-features
  Sparse and discrete interpretability tool for neural networks
  ☆64Updated last year
• EvolvingLMMs-Lab / multimodal-sae
  [ICCV 2025] Auto Interpretation Pipeline and many other functionalities for Multimodal SAE Analysis.
  ☆173Updated 3 months ago
• ml-jku / EVA
  One Initialization to Rule them All: Fine-tuning via Explained Variance Adaptation
  ☆46Updated 2 months ago
• RobertCsordas / moeut
  ☆91Updated last year
• wang-kee / LiNeS
  Official repository of "LiNeS: Post-training Layer Scaling Prevents Forgetting and Enhances Model Merging"
  ☆31Updated last year
• lucidrains / PEER-pytorch
  Pytorch implementation of the PEER block from the paper, Mixture of A Million Experts, by Xu Owen He at Deepmind
  ☆132Updated 2 months ago
• JoshEngels / MultiDimensionalFeatures
  Code for reproducing our paper "Not All Language Model Features Are Linear"
  ☆83Updated last year
• llm-merging / LLM-Merging
  LLM-Merging: Building LLMs Efficiently through Merging
  ☆208Updated last year
• kyegomez / Mixture-of-Depths
  Implementation of the paper: "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"
  ☆112Updated last week
• prateeky2806 / ties-merging
  ☆204Updated last year
• adamkarvonen / SAE_BoardGameEval
  ☆23Updated 11 months ago
• sail-sg / Attention-Sink
  [ICLR 2025] When Attention Sink Emerges in Language Models: An Empirical View (Spotlight)
  ☆152Updated 6 months ago
• uclaml / MoE
  Towards Understanding the Mixture-of-Experts Layer in Deep Learning
  ☆34Updated 2 years ago
• KempnerInstitute / overcomplete
  👋 Overcomplete is a Vision-based SAE Toolbox
  ☆114Updated last month
• Luckfort / CD
  [COLING'25] Exploring Concept Depth: How Large Language Models Acquire Knowledge at Different Layers?
  ☆82Updated 11 months ago
• mcleish7 / arithmetic
  Code to reproduce "Transformers Can Do Arithmetic with the Right Embeddings", McLeish et al (NeurIPS 2024)
  ☆198Updated last year
• wmn-231314 / diffusion-data-constraint
  Official PyTorch implementation and models for paper "Diffusion Beats Autoregressive in Data-Constrained Settings". We find diffusion mod…
  ☆118Updated last week
• MadryLab / DsDm
  ☆51Updated last year
• EleutherAI / delphi
  Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …
  ☆236Updated last week