Alternatives and similar repositories for pytorch-mixtures

Users that are interested in pytorch-mixtures are comparing it to the libraries listed below

• kpup1710 / CAMEx
  [ICLR 2025] CAMEx: Curvature-Aware Merging of Experts
  ☆22Updated 11 months ago
• ExplainableML / fomo_in_flux
  Code and benchmark for the paper: "A Practitioner's Guide to Continual Multimodal Pretraining" [NeurIPS'24]
  ☆61Updated last year
• apple / ml-tic-clip
  Repository for the paper: "TiC-CLIP: Continual Training of CLIP Models" ICLR 2024
  ☆110Updated last year
• surkovv / sdxl-unbox
  Sparse Autoencoders for Stable Diffusion XL models.
  ☆79Updated 3 months ago
• facebookresearch / MobileLLM-R1
  MobileLLM-R1
  ☆75Updated 4 months ago
• wang-kee / LiNeS
  Official repository of "LiNeS: Post-training Layer Scaling Prevents Forgetting and Enhances Model Merging"
  ☆31Updated last year
• facebookresearch / ViP-MAE
  This is a PyTorch implementation of the paperViP A Differentially Private Foundation Model for Computer Vision
  ☆36Updated 2 years ago
• fangyuan-ksgk / selective-attention-transformer
  Unofficial Implementation of Selective Attention Transformer
  ☆20Updated last year
• gstoica27 / KnOTS
  Model Merging with SVD to Tie the KnOTS [ICLR 2025]
  ☆85Updated 9 months ago
• zju-vipa / training_free_model_merging
  This repository is the implementation of the paper Training Free Pretrained Model Merging (CVPR2024).
  ☆32Updated last year
• nreHieW / minARImageGen
  Autoregressive Image Generation
  ☆31Updated 7 months ago
• lucidrains / infini-transformer-pytorch
  Implementation of Infini-Transformer in Pytorch
  ☆112Updated last year
• KindXiaoming / physics_of_skill_learning
  We study toy models of skill learning.
  ☆31Updated last year
• lucidrains / multimodal-dit-pytorch
  Implementation of a multimodal diffusion transformer in Pytorch
  ☆107Updated last year
• TianjinYellow / SPAM-Optimizer
  ☆36Updated 10 months ago
• SriramB-98 / vit-decompose
  ☆23Updated last year
• SHI-Labs / CompactNet
  ☆32Updated last year
• Trustworthy-ML-Lab / Linear-Explanations
  [ICML 24] A novel automated neuron explanation framework that can accurately describe poly-semantic concepts in deep neural networks
  ☆14Updated 8 months ago
• fkodom / soft-mixture-of-experts
  PyTorch implementation of Soft MoE by Google Brain in "From Sparse to Soft Mixtures of Experts" (https://arxiv.org/pdf/2308.00951.pdf)
  ☆82Updated 2 years ago
• oripress / EntropyEnigma
  Official code for the ICML 2024 paper "The Entropy Enigma: Success and Failure of Entropy Minimization"
  ☆55Updated last year
• Rose-STL-Lab / Teleportation-Optimization
  [ICLR 2024 Oral] Improving Convergence and Generalization Using Parameter Symmetries
  ☆31Updated last year
• LIONS-EPFL / scion
  ☆52Updated last month
• OscarXZQ / weight-selection
  ☆191Updated last year
• pilancilab / Riemannian_Preconditioned_LoRA
  source code for paper "Riemannian Preconditioned LoRA for Fine-Tuning Foundation Models"
  ☆33Updated last year
• lucidrains / contrastive-rl
  Contrastive Reinforcement Learning
  ☆59Updated 2 weeks ago
• Trustworthy-ML-Lab / Describe-and-Dissect
  [TMLR 25] An automated method for explaining complex neuron behaviors in deep vision models using large language models
  ☆10Updated 11 months ago
• facebookresearch / iclmlp
  Experiments for "A Closer Look at In-Context Learning under Distribution Shifts"
  ☆19Updated 2 years ago
• jongwooko / distillm-2
  Official PyTorch implementation of DistiLLM-2: A Contrastive Approach Boosts the Distillation of LLMs (ICML 2025 Oral)
  ☆55Updated 7 months ago
• lucidrains / mixture-of-attention
  Some personal experiments around routing tokens to different autoregressive attention, akin to mixture-of-experts
  ☆122Updated last year
• AvivNavon / DWSNets
  Official implementation for Equivariant Architectures for Learning in Deep Weight Spaces [ICML 2023]
  ☆90Updated 2 years ago