lucidrains / transfusion-pytorch
Pytorch implementation of Transfusion, "Predict the Next Token and Diffuse Images with One Multi-Modal Model", from MetaAI
☆725Updated this week
Related projects ⓘ
Alternatives and complementary repositories for transfusion-pytorch
- PyTorch implementation of MAR+DiffLoss https://arxiv.org/abs/2406.11838☆1,020Updated last month
- Repository for Show-o, One Single Transformer to Unify Multimodal Understanding and Generation.☆1,030Updated this week
- This repo contains the code for 1D tokenizer and generator☆554Updated this week
- Implementation of MagViT2 Tokenizer in Pytorch☆564Updated last month
- Open-MAGVIT2: Democratizing Autoregressive Visual Generation☆705Updated last month
- Autoregressive Model Beats Diffusion: 🦙 Llama for Scalable Image Generation☆1,327Updated 3 months ago
- Official Pytorch Implementation of Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Think☆669Updated last week
- Official PyTorch Implementation of "SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformers"☆689Updated 8 months ago
- Implementation of Autoregressive Diffusion in Pytorch☆302Updated 2 weeks ago
- code for "Diffusion Forcing: Next-token Prediction Meets Full-Sequence Diffusion"☆616Updated last week
- PyTorch implementation of RCG https://arxiv.org/abs/2312.03701☆839Updated last month
- LaVIT: Empower the Large Language Model to Understand and Generate Visual Content☆535Updated last month
- A suite of image and video neural tokenizers☆824Updated last week
- A PyTorch implementation of the paper "All are Worth Words: A ViT Backbone for Diffusion Models".☆923Updated last year
- [CVPR 2024] Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teachers☆527Updated 3 weeks ago
- [ECCV 2024] Official Repository for DiffiT: Diffusion Vision Transformers for Image Generation☆459Updated 3 weeks ago
- 📖 This is a repository for organizing papers, codes and other resources related to unified multimodal models.☆217Updated 2 weeks ago
- Official Implementation of Rectified Flow (ICLR2023 Spotlight)☆960Updated 4 months ago
- [ECCV 2024] official code for "Long-CLIP: Unlocking the Long-Text Capability of CLIP"☆681Updated 3 months ago
- [ICML2024 (Oral)] Official PyTorch implementation of DoRA: Weight-Decomposed Low-Rank Adaptation☆635Updated last month
- Next-Token Prediction is All You Need☆1,832Updated 3 weeks ago
- The official GitHub page for the review paper "Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision M…☆491Updated 8 months ago
- Code for Fast Training of Diffusion Models with Masked Transformers☆375Updated 6 months ago
- 【ICLR 2024🔥】 Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignment☆729Updated 7 months ago
- ☆573Updated 9 months ago
- Masked Diffusion Transformer is the SOTA for image synthesis. (ICCV 2023)☆528Updated 7 months ago
- [ICML 2024 Spotlight] FiT: Flexible Vision Transformer for Diffusion Model☆389Updated last week
- A Framework of Small-scale Large Multimodal Models☆656Updated this week
- When do we not need larger vision models?☆336Updated last week
- Official implementation of SEED-LLaMA (ICLR 2024).☆582Updated 2 months ago