lucidrains / transfusion-pytorch
Pytorch implementation of Transfusion, "Predict the Next Token and Diffuse Images with One Multi-Modal Model", from MetaAI
☆1,087Updated last month
Alternatives and similar repositories for transfusion-pytorch:
Users that are interested in transfusion-pytorch are comparing it to the libraries listed below
- PyTorch implementation of MAR+DiffLoss https://arxiv.org/abs/2406.11838☆1,512Updated 7 months ago
- This repo contains the code for 1D tokenizer and generator☆848Updated last month
- SEED-Voken: A Series of Powerful Visual Tokenizers☆872Updated 2 months ago
- Autoregressive Model Beats Diffusion: 🦙 Llama for Scalable Image Generation☆1,735Updated 8 months ago
- [ICLR'25 Oral] Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Think☆986Updated last month
- [ICLR 2025] Repository for Show-o, One Single Transformer to Unify Multimodal Understanding and Generation.☆1,369Updated last week
- code for "Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusion"☆843Updated last month
- Implementation of MagViT2 Tokenizer in Pytorch☆601Updated 3 months ago
- Official PyTorch Implementation of "SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformers"☆826Updated last year
- [TMLR 2025🔥] A survey for the autoregressive models in vision.☆542Updated last week
- Implementation of Autoregressive Diffusion in Pytorch☆376Updated 6 months ago
- PyTorch implementation of RCG https://arxiv.org/abs/2312.03701☆913Updated 7 months ago
- [CVPR 2025 Oral]Infinity ∞ : Scaling Bitwise AutoRegressive Modeling for High-Resolution Image Synthesis☆1,248Updated last week
- ☆484Updated 5 months ago
- PyTorch implementation of FractalGen https://arxiv.org/abs/2502.17437☆1,092Updated 2 months ago
- 📖 This is a repository for organizing papers, codes and other resources related to unified multimodal models.☆535Updated 3 weeks ago
- Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Models☆569Updated 3 weeks ago
- A PyTorch implementation of the paper "All are Worth Words: A ViT Backbone for Diffusion Models".☆1,003Updated 2 years ago
- [CVPR 2025 Oral] Reconstruction vs. Generation: Taming Optimization Dilemma in Latent Diffusion Models☆720Updated 3 weeks ago
- Next-Token Prediction is All You Need☆2,111Updated last month
- Official Implementation of Rectified Flow (ICLR2023 Spotlight)☆1,217Updated 9 months ago
- Official PyTorch implementation of Learning to (Learn at Test Time): RNNs with Expressive Hidden States☆1,182Updated 9 months ago
- [Survey] Next Token Prediction Towards Multimodal Intelligence: A Comprehensive Survey☆422Updated 3 months ago
- LaVIT: Empower the Large Language Model to Understand and Generate Visual Content☆578Updated 7 months ago
- [ECCV 2024] Official Repository for DiffiT: Diffusion Vision Transformers for Image Generation☆492Updated 6 months ago
- [ICML2024 (Oral)] Official PyTorch implementation of DoRA: Weight-Decomposed Low-Rank Adaptation☆775Updated 7 months ago
- Implementation of a single layer of the MMDiT, proposed in Stable Diffusion 3, in Pytorch☆351Updated 3 months ago
- Implementation of the sparse attention pattern proposed by the Deepseek team in their "Native Sparse Attention" paper☆607Updated last month
- The official GitHub page for the review paper "Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision M…☆498Updated last year
- 🔥🔥🔥 A curated list of papers on LLMs-based multimodal generation (image, video, 3D and audio).☆469Updated last month