Alternatives and similar repositories for pytorch-mixtures

Users that are interested in pytorch-mixtures are comparing it to the libraries listed below

• kpup1710 / CAMEx
  [ICLR 2025] CAMEx: Curvature-Aware Merging of Experts
  ☆22Updated 6 months ago
• ExplainableML / fomo_in_flux
  Code and benchmark for the paper: "A Practitioner's Guide to Continual Multimodal Pretraining" [NeurIPS'24]
  ☆58Updated 9 months ago
• facebookresearch / ViP-MAE
  This is a PyTorch implementation of the paperViP A Differentially Private Foundation Model for Computer Vision
  ☆36Updated 2 years ago
• lucidrains / multimodal-dit-pytorch
  Implementation of a multimodal diffusion transformer in Pytorch
  ☆104Updated last year
• MarkXCloud / CSpD
  The official repo of continuous speculative decoding
  ☆29Updated 5 months ago
• AvivNavon / DWSNets
  Official implementation for Equivariant Architectures for Learning in Deep Weight Spaces [ICML 2023]
  ☆89Updated 2 years ago
• surkovv / sdxl-unbox
  Sparse Autoencoders for Stable Diffusion XL models.
  ☆69Updated last month
• kirill-vish / Beyond-INet
  Code for experiments for "ConvNet vs Transformer, Supervised vs CLIP: Beyond ImageNet Accuracy"
  ☆101Updated last year
• albanie / foundation-models
  Video descriptions of research papers relating to foundation models and scaling
  ☆31Updated 2 years ago
• kyegomez / SparseAttention
  Pytorch Implementation of the sparse attention from the paper: "Generating Long Sequences with Sparse Transformers"
  ☆86Updated last week
• TianjinYellow / SPAM-Optimizer
  ☆35Updated 6 months ago
• lucidrains / contrastive-rl
  Contrastive Reinforcement Learning
  ☆44Updated 2 weeks ago
• lucidrains / mixture-of-attention
  Some personal experiments around routing tokens to different autoregressive attention, akin to mixture-of-experts
  ☆121Updated 11 months ago
• nreHieW / minARImageGen
  Autoregressive Image Generation
  ☆32Updated 3 months ago
• apple / ml-tic-clip
  Repository for the paper: "TiC-CLIP: Continual Training of CLIP Models" ICLR 2024
  ☆104Updated last year
• iancovert / locality-alignment
  ☆52Updated 8 months ago
• Rose-STL-Lab / Teleportation-Optimization
  [ICLR 2024 Oral] Improving Convergence and Generalization Using Parameter Symmetries
  ☆29Updated last year
• Adamdad / neumeta
  NeuMeta transforms neural networks by allowing a single model to adapt on the fly to different sizes, generating the right weights when n…
  ☆43Updated 10 months ago
• fkodom / soft-mixture-of-experts
  PyTorch implementation of Soft MoE by Google Brain in "From Sparse to Soft Mixtures of Experts" (https://arxiv.org/pdf/2308.00951.pdf)
  ☆78Updated last year
• gstoica27 / KnOTS
  Model Merging with SVD to Tie the KnOTS [ICLR 2025]
  ☆66Updated 5 months ago
• lucidrains / deep-cross-attention
  Implementation of the proposed DeepCrossAttention by Heddes et al at Google research, in Pytorch
  ☆93Updated 6 months ago
• fangyuan-ksgk / Mini-LLaVA
  A minimal implementation of LLaVA-style VLM with interleaved image & text & video processing ability.
  ☆96Updated 9 months ago
• byM1902 / ViT_visualization
  ☆12Updated 3 years ago
• ycjing / Awesome-Model-Merging
  A curated list of Model Merging methods.
  ☆92Updated last year
• oripress / EntropyEnigma
  Official code for the ICML 2024 paper "The Entropy Enigma: Success and Failure of Entropy Minimization"
  ☆53Updated last year
• lucidrains / agent-attention-pytorch
  Implementation of Agent Attention in Pytorch
  ☆91Updated last year
• zju-vipa / training_free_model_merging
  This repository is the implementation of the paper Training Free Pretrained Model Merging (CVPR2024).
  ☆31Updated last year
• YuxinWenRick / diffusion_memorization
  Official repo for Detecting, Explaining, and Mitigating Memorization in Diffusion Models (ICLR 2024)
  ☆76Updated last year
• lucidrains / PEER-pytorch
  Pytorch implementation of the PEER block from the paper, Mixture of A Million Experts, by Xu Owen He at Deepmind
  ☆128Updated last year
• UCDvision / NOLA
  Code for NOLA, an implementation of "nola: Compressing LoRA using Linear Combination of Random Basis"
  ☆56Updated last year