Alternatives and similar repositories for modelcomponents:

Users that are interested in modelcomponents are comparing it to the libraries listed below

• ycjing / Awesome-Model-Merging
  A curated list of Model Merging methods.
  ☆89Updated 4 months ago
• goombalab / phi-mamba
  Official implementation of Phi-Mamba. A MOHAWK-distilled model (Transformers to SSMs: Distilling Quadratic Knowledge to Subquadratic Mode…
  ☆92Updated 4 months ago
• multimodal-interpretability / maia
  Official implementation of MAIA, A Multimodal Automated Interpretability Agent
  ☆70Updated 5 months ago
• AmeenAli / HiddenMambaAttn
  Official PyTorch Implementation of "The Hidden Attention of Mamba Models"
  ☆209Updated 7 months ago
• EvolvingLMMs-Lab / multimodal-sae
  Auto Interpretation Pipeline and many other functionalities for Multimodal SAE Analysis.
  ☆97Updated 2 weeks ago
• g-luo / task_vectors_are_cross_modal
  Official PyTorch Implementation for Task Vectors are Cross-Modal
  ☆21Updated last month
• uclaml / MoE
  Towards Understanding the Mixture-of-Experts Layer in Deep Learning
  ☆22Updated last year
• locuslab / massive-activations
  Code accompanying the paper "Massive Activations in Large Language Models"
  ☆133Updated 10 months ago
• prateeky2806 / ties-merging
  ☆159Updated 11 months ago
• RobertCsordas / moeut
  ☆69Updated 5 months ago
• yihedeng9 / rlhf-summary-notes
  A brief and partial summary of RLHF algorithms.
  ☆89Updated last month
• architsharma97 / dpo-rlaif
  ☆93Updated 6 months ago
• AvivBick / awesome-ssm-ml
  Reading list for research topics in state-space models
  ☆253Updated 3 weeks ago
• jxiw / MambaInLlama
  [NeurIPS 2024] Official Repository of The Mamba in the Llama: Distilling and Accelerating Hybrid Models
  ☆188Updated 2 weeks ago
• mcleish7 / arithmetic
  Code to reproduce "Transformers Can Do Arithmetic with the Right Embeddings", McLeish et al (NeurIPS 2024)
  ☆182Updated 7 months ago
• ranpox / openreview-visualization
  OpenReivew Submission Visualization (ICLR 2024/2025)
  ☆148Updated 3 months ago
• KihoPark / linear_rep_geometry
  ☆82Updated 11 months ago
• Leiay / looped_transformer
  ☆22Updated last year
• sail-sg / GDPO
  Graph Diffusion Policy Optimization
  ☆29Updated 10 months ago
• mkofinas / neural-graphs
  Official source code for "Graph Neural Networks for Learning Equivariant Representations of Neural Networks". In ICLR 2024 (oral).
  ☆76Updated 5 months ago
• yu-rp / KANbeFair
  A More Fair and Comprehensive Comparison between KAN and MLP
  ☆155Updated 5 months ago
• CERT-Lab / lora-sb
  Initialization using Update Approximation is a Silver Bullet for Extremely Efficient Low-Rank Fine-Tuning
  ☆41Updated this week
• katiekang1998 / reasoning_generalization
  ☆21Updated last week
• HoagyC / sparse_coding
  Using sparse coding to find distributed representations used by neural networks.
  ☆207Updated last year
• ml-jku / EVA
  One Initialization to Rule them All: Fine-tuning via Explained Variance Adaptation
  ☆36Updated 3 months ago
• koayon / awesome-adaptive-computation
  A curated reading list of research in Adaptive Computation, Inference-Time Computation & Mixture of Experts (MoE).
  ☆136Updated 2 weeks ago
• JoshEngels / MultiDimensionalFeatures
  Code for reproducing our paper "Not All Language Model Features Are Linear"
  ☆66Updated last month
• tml-epfl / why-weight-decay
  Why Do We Need Weight Decay in Modern Deep Learning? [NeurIPS 2024]
  ☆58Updated 3 months ago
• abdelwahed / OT_for_big_data
  Optimal Transport in the Big Data Era
  ☆98Updated 2 months ago
• kyegomez / MambaTransformer
  Integrating Mamba/SSMs with Transformer for Enhanced Long Context and High-Quality Sequence Modeling
  ☆180Updated 2 months ago