Alternatives and similar repositories for Mixture-of-Transformers

Users that are interested in Mixture-of-Transformers are comparing it to the libraries listed below

• facebookresearch / unibench
  Python Library to evaluate VLM models' robustness across diverse benchmarks
  ☆217Updated this week
• wmn-231314 / diffusion-data-constraint
  Official PyTorch implementation and models for paper "Diffusion Beats Autoregressive in Data-Constrained Settings". We find diffusion mod…
  ☆101Updated last month
• JinjieNi / dlms-are-super-data-learners
  The official github repo for "Diffusion Language Models are Super Data Learners".
  ☆135Updated 3 weeks ago
• callsys / GMPO
  Geometric-Mean Policy Optimization
  ☆86Updated last week
• zhixuan-lin / forgetting-transformer
  [ICLR 2025 & COLM 2025] Official PyTorch implementation of the Forgetting Transformer and Adaptive Computation Pruning
  ☆131Updated last month
• chenllliang / DnD-Transformer
  [ICLR 2025] Source code for paper "A Spark of Vision-Language Intelligence: 2-Dimensional Autoregressive Transformer for Efficient Finegr…
  ☆77Updated 10 months ago
• philippe-eecs / vitok
  ☆34Updated 5 months ago
• ChenWu98 / algorithmic-creativity
  [ICML 2025] Roll the dice & look before you leap: Going beyond the creative limits of next-token prediction
  ☆72Updated 5 months ago
• g-luo / vlm_cross_modal_reps
  Official PyTorch Implementation for Vision-Language Models Create Cross-Modal Task Representations, ICML 2025
  ☆31Updated 5 months ago
• EvolvingLMMs-Lab / multimodal-sae
  [ICCV 2025] Auto Interpretation Pipeline and many other functionalities for Multimodal SAE Analysis.
  ☆159Updated last month
• lucidrains / coconut-pytorch
  Implementation of 🥥 Coconut, Chain of Continuous Thought, in Pytorch
  ☆179Updated 4 months ago
• lucidrains / multimodal-dit-pytorch
  Implementation of a multimodal diffusion transformer in Pytorch
  ☆106Updated last year
• lucidrains / titok-pytorch
  Implementation of TiTok, proposed by Bytedance in "An Image is Worth 32 Tokens for Reconstruction and Generation"
  ☆181Updated last year
• jacklishufan / LaViDa
  Official Implementation of LaViDa: :A Large Diffusion Language Model for Multimodal Understanding
  ☆158Updated 3 months ago
• rbalestr-lab / llm-jepa
  ☆109Updated 3 weeks ago
• aakaran / reasoning-with-sampling
  ☆64Updated last week
• jiasenlu / LL3M
  LL3M: Large Language and Multi-Modal Model in Jax
  ☆74Updated last year
• mu-cai / matryoshka-mm
  Matryoshka Multimodal Models
  ☆112Updated 9 months ago
• bluorion-com / ZClip
  Official implementation of the paper: "ZClip: Adaptive Spike Mitigation for LLM Pre-Training".
  ☆135Updated last week
• RobertCsordas / moeut
  ☆86Updated last year
• jxiw / MambaInLlama
  [NeurIPS 2024] Official Repository of The Mamba in the Llama: Distilling and Accelerating Hybrid Models
  ☆231Updated last week
• goombalab / phi-mamba
  Official implementation of Phi-Mamba. A MOHAWK-distilled model (Transformers to SSMs: Distilling Quadratic Knowledge to Subquadratic Mode…
  ☆116Updated last year
• tulip-berkeley / open_clip
  An open source implementation of CLIP (With TULIP Support)
  ☆162Updated 5 months ago
• huggingface / fineVideo
  ☆89Updated last year
• LeslieTrue / SFTvsRL
  Official implementation of paper: SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-training
  ☆301Updated 5 months ago
• lucidrains / PEER-pytorch
  Pytorch implementation of the PEER block from the paper, Mixture of A Million Experts, by Xu Owen He at Deepmind
  ☆129Updated last year
• NVlabs / RLP
  RLP: Reinforcement as a Pretraining Objective
  ☆192Updated 3 weeks ago
• si0wang / ThinkLite-VL
  ☆101Updated 4 months ago
• lucidrains / maskbit-pytorch
  Implementation of the proposed MaskBit from Bytedance AI
  ☆82Updated 11 months ago
• FreedomIntelligence / LongLLaVA
  LongLLaVA: Scaling Multi-modal LLMs to 1000 Images Efficiently via Hybrid Architecture
  ☆211Updated 9 months ago