lucidrains / transfusion-pytorch
Pytorch implementation of Transfusion, "Predict the Next Token and Diffuse Images with One Multi-Modal Model", from MetaAI
☆950Updated 2 weeks ago
Alternatives and similar repositories for transfusion-pytorch:
Users that are interested in transfusion-pytorch are comparing it to the libraries listed below
- PyTorch implementation of MAR+DiffLoss https://arxiv.org/abs/2406.11838☆1,285Updated 4 months ago
- SEED-Voken: A Series of Powerful Visual Tokenizers☆830Updated this week
- [ICLR 2025] Repository for Show-o, One Single Transformer to Unify Multimodal Understanding and Generation.☆1,220Updated last week
- This repo contains the code for 1D tokenizer and generator☆691Updated last week
- Implementation of MagViT2 Tokenizer in Pytorch☆590Updated last month
- Official PyTorch Implementation of "SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformers"☆764Updated 11 months ago
- Autoregressive Model Beats Diffusion: 🦙 Llama for Scalable Image Generation☆1,576Updated 6 months ago
- Official Pytorch Implementation of Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Think (ICL…☆832Updated 3 weeks ago
- Implementation of Autoregressive Diffusion in Pytorch☆356Updated 3 months ago
- code for "Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusion"☆730Updated this week
- 📖 This is a repository for organizing papers, codes and other resources related to unified multimodal models.☆374Updated last month
- The paper collections for the autoregressive models in vision.☆406Updated this week
- PyTorch implementation of RCG https://arxiv.org/abs/2312.03701☆902Updated 4 months ago
- ☆599Updated last year
- Infinity ∞ : Scaling Bitwise AutoRegressive Modeling for High-Resolution Image Synthesis☆968Updated this week
- Next-Token Prediction is All You Need☆2,004Updated 3 months ago
- [Survey] Next Token Prediction Towards Multimodal Intelligence: A Comprehensive Survey☆357Updated last month
- [ECCV 2024] Official PyTorch implementation of RoPE-ViT "Rotary Position Embedding for Vision Transformer"☆283Updated 2 months ago
- LaVIT: Empower the Large Language Model to Understand and Generate Visual Content☆561Updated 4 months ago
- ☆376Updated 2 months ago
- When do we not need larger vision models?☆368Updated last week
- Masked Diffusion Transformer is the SOTA for image synthesis. (ICCV 2023)☆547Updated 9 months ago
- Official Implementation of Rectified Flow (ICLR2023 Spotlight)☆1,096Updated 7 months ago
- Cambrian-1 is a family of multimodal LLMs with a vision-centric design.☆1,854Updated 3 months ago
- A PyTorch implementation of the paper "All are Worth Words: A ViT Backbone for Diffusion Models".☆969Updated last year
- Implementation of a single layer of the MMDiT, proposed in Stable Diffusion 3, in Pytorch☆307Updated last month
- A collection of resources and papers on Vector Quantized Variational Autoencoder (VQ-VAE) and its application☆251Updated 3 weeks ago
- The official GitHub page for the review paper "Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision M…☆495Updated 11 months ago
- [ICLR2025 Spotlight🔥] Official Implementation of TokenFormer: Rethinking Transformer Scaling with Tokenized Model Parameters☆514Updated last week