lucidrains / transfusion-pytorch
Pytorch implementation of Transfusion, "Predict the Next Token and Diffuse Images with One Multi-Modal Model", from MetaAI
☆1,052Updated 3 weeks ago
Alternatives and similar repositories for transfusion-pytorch:
Users that are interested in transfusion-pytorch are comparing it to the libraries listed below
- PyTorch implementation of MAR+DiffLoss https://arxiv.org/abs/2406.11838☆1,467Updated 6 months ago
- This repo contains the code for 1D tokenizer and generator☆821Updated 3 weeks ago
- [ICLR'25 Oral] Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Think☆908Updated last month
- SEED-Voken: A Series of Powerful Visual Tokenizers☆863Updated last month
- [ICLR 2025] Repository for Show-o, One Single Transformer to Unify Multimodal Understanding and Generation.☆1,338Updated 2 weeks ago
- Autoregressive Model Beats Diffusion: 🦙 Llama for Scalable Image Generation☆1,684Updated 8 months ago
- Official PyTorch Implementation of "SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformers"☆800Updated last year
- Implementation of Autoregressive Diffusion in Pytorch☆369Updated 5 months ago
- Implementation of MagViT2 Tokenizer in Pytorch☆599Updated 3 months ago
- code for "Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusion"☆803Updated 2 weeks ago
- 📖 This is a repository for organizing papers, codes and other resources related to unified multimodal models.☆496Updated last week
- [CVPR 2025 Oral] Reconstruction vs. Generation: Taming Optimization Dilemma in Latent Diffusion Models☆674Updated last week
- PyTorch implementation of FractalGen https://arxiv.org/abs/2502.17437☆1,062Updated last month
- PyTorch implementation of RCG https://arxiv.org/abs/2312.03701☆911Updated 6 months ago
- [CVPR 2025 Oral]Infinity ∞ : Scaling Bitwise AutoRegressive Modeling for High-Resolution Image Synthesis☆1,180Updated last month
- Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Models☆519Updated this week
- [TMLR 2025🔥] A survey for the autoregressive models in vision.☆504Updated this week
- A PyTorch implementation of the paper "All are Worth Words: A ViT Backbone for Diffusion Models".☆995Updated 2 years ago
- Next-Token Prediction is All You Need☆2,076Updated last month
- Official Implementation of Rectified Flow (ICLR2023 Spotlight)☆1,197Updated 8 months ago
- [ICLR2025 Spotlight🔥] Official Implementation of TokenFormer: Rethinking Transformer Scaling with Tokenized Model Parameters☆547Updated 2 months ago
- [ICML2024 (Oral)] Official PyTorch implementation of DoRA: Weight-Decomposed Low-Rank Adaptation☆763Updated 6 months ago
- [ECCV 2024] Official Repository for DiffiT: Diffusion Vision Transformers for Image Generation☆490Updated 5 months ago
- ☆447Updated 4 months ago
- [Survey] Next Token Prediction Towards Multimodal Intelligence: A Comprehensive Survey☆416Updated 3 months ago
- [ECCV 2024] official code for "Long-CLIP: Unlocking the Long-Text Capability of CLIP"☆783Updated 8 months ago
- The official GitHub page for the review paper "Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision M…☆497Updated last year
- Implementation of a single layer of the MMDiT, proposed in Stable Diffusion 3, in Pytorch☆338Updated 3 months ago
- Official PyTorch implementation of Learning to (Learn at Test Time): RNNs with Expressive Hidden States☆1,170Updated 9 months ago
- A Framework of Small-scale Large Multimodal Models☆796Updated 3 weeks ago