Alternatives and similar repositories for Mixture-of-Transformers

Users that are interested in Mixture-of-Transformers are comparing it to the libraries listed below

• JinjieNi / dlms-are-super-data-learners
  The official github repo for "Diffusion Language Models are Super Data Learners".
  ☆207Updated last month
• wmn-231314 / diffusion-data-constraint
  Official PyTorch implementation and models for paper "Diffusion Beats Autoregressive in Data-Constrained Settings". We find diffusion mod…
  ☆109Updated last month
• chenllliang / DnD-Transformer
  [ICLR 2025] Source code for paper "A Spark of Vision-Language Intelligence: 2-Dimensional Autoregressive Transformer for Efficient Finegr…
  ☆79Updated 11 months ago
• g-luo / vlm_cross_modal_reps
  Official PyTorch Implementation for Vision-Language Models Create Cross-Modal Task Representations, ICML 2025
  ☆31Updated 7 months ago
• lucidrains / titok-pytorch
  Implementation of TiTok, proposed by Bytedance in "An Image is Worth 32 Tokens for Reconstruction and Generation"
  ☆181Updated last year
• zhixuan-lin / forgetting-transformer
  [ICLR 2025 & COLM 2025] Official PyTorch implementation of the Forgetting Transformer and Adaptive Computation Pruning
  ☆134Updated last month
• lucidrains / multimodal-dit-pytorch
  Implementation of a multimodal diffusion transformer in Pytorch
  ☆106Updated last year
• facebookresearch / unibench
  Python Library to evaluate VLM models' robustness across diverse benchmarks
  ☆220Updated last month
• philippe-eecs / vitok
  ☆34Updated 6 months ago
• ChenWu98 / algorithmic-creativity
  [ICML 2025] Roll the dice & look before you leap: Going beyond the creative limits of next-token prediction
  ☆80Updated 6 months ago
• callsys / GMPO
  Geometric-Mean Policy Optimization
  ☆95Updated 3 weeks ago
• lucidrains / coconut-pytorch
  Implementation of 🥥 Coconut, Chain of Continuous Thought, in Pytorch
  ☆180Updated 5 months ago
• jacklishufan / LaViDa
  Official Implementation of LaViDa: :A Large Diffusion Language Model for Multimodal Understanding
  ☆178Updated this week
• SalesforceAIResearch / LATTE
  ☆68Updated 2 months ago
• LeslieTrue / SFTvsRL
  Official implementation of paper: SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-training
  ☆312Updated 7 months ago
• EvolvingLMMs-Lab / multimodal-sae
  [ICCV 2025] Auto Interpretation Pipeline and many other functionalities for Multimodal SAE Analysis.
  ☆165Updated 2 months ago
• huggingface / fineVideo
  ☆93Updated last year
• google-deepmind / tips
  ☆107Updated 7 months ago
• fal-ai-community / nano-mdm
  Tiny re-implementation of MDM in style of LLaDA and nano-gpt speedrun
  ☆57Updated 8 months ago
• rbalestr-lab / llm-jepa
  ☆137Updated 2 months ago
• goombalab / phi-mamba
  Official implementation of Phi-Mamba. A MOHAWK-distilled model (Transformers to SSMs: Distilling Quadratic Knowledge to Subquadratic Mode…
  ☆116Updated last year
• jxiw / MambaInLlama
  [NeurIPS 2024] Official Repository of The Mamba in the Llama: Distilling and Accelerating Hybrid Models
  ☆232Updated last month
• jiasenlu / LL3M
  LL3M: Large Language and Multi-Modal Model in Jax
  ☆74Updated last year
• facebookresearch / webssl
  Code for "Scaling Language-Free Visual Representation Learning" paper (Web-SSL).
  ☆189Updated 7 months ago
• RWKV / RWKV-LM
  RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best…
  ☆57Updated 8 months ago
• keshik6 / grafting
  [NeurIPS 2025 Oral] Exploring Diffusion Transformer Designs via Grafting
  ☆64Updated 5 months ago
• s-sahoo / Eso-LMs
  Esoteric Language Models
  ☆107Updated last week
• tulip-berkeley / open_clip
  An open source implementation of CLIP (With TULIP Support)
  ☆163Updated 6 months ago
• mu-cai / matryoshka-mm
  Matryoshka Multimodal Models
  ☆119Updated 10 months ago
• FreedomIntelligence / LongLLaVA
  LongLLaVA: Scaling Multi-modal LLMs to 1000 Images Efficiently via Hybrid Architecture
  ☆211Updated 11 months ago