researchmm / MM-Diffusion
[CVPR'23] MM-Diffusion: Learning Multi-Modal Diffusion Models for Joint Audio and Video Generation
☆417Updated 9 months ago
Alternatives and similar repositories for MM-Diffusion:
Users that are interested in MM-Diffusion are comparing it to the libraries listed below
- Official PyTorch implementation of TATS: A Long Video Generation Framework with Time-Agnostic VQGAN and Time-Sensitive Transformer (ECCV …☆279Updated 10 months ago
- Official PyTorch implementation of Video Probabilistic Diffusion Models in Projected Latent Space (CVPR 2023).☆314Updated 10 months ago
- Official Pytorch Implementation of Synthesizing Coherent Story with Auto-Regressive Latent Diffusion Models☆196Updated last year
- [ICLR2024] The official implementation of paper "VDT: General-purpose Video Diffusion Transformers via Mask Modeling", by Haoyu Lu, Guoxi…☆229Updated 10 months ago
- [ICLR2023] Discrete Contrastive Diffusion for Cross-Modal Music and Image Generation (CDCD).☆155Updated last year
- Official Pytorch Implementation of Our CVPR2023 Paper: "Towards Accurate Image Coding: Improved Autoregressive Image Generation with Dyna…☆167Updated last year
- Masked Diffusion Transformer is the SOTA for image synthesis. (ICCV 2023)☆552Updated 10 months ago
- The pytorch implementation of our CVPR 2023 paper "Conditional Image-to-Video Generation with Latent Flow Diffusion Models"☆460Updated 8 months ago
- LVDM: Latent Video Diffusion Models for High-Fidelity Long Video Generation☆471Updated 3 months ago
- ☆454Updated 2 years ago
- Implementation of MagViT2 Tokenizer in Pytorch☆595Updated 2 months ago
- [ICCV 2023] Online Clustered Codebook☆161Updated 5 months ago
- [ICCV 2023] Official PyTorch implementation for the paper "FreeDoM: Training-Free Energy-Guided Conditional Diffusion Model"☆281Updated last year
- Official PyTorch implementation of the paper "In-Context Learning Unlocked for Diffusion Models"☆393Updated 11 months ago
- [CVPR 2024] Seeing and Hearing: Open-domain Visual-Audio Generation with Diffusion Latent Aligners☆140Updated 8 months ago
- [CVPR 2024] | LAMP: Learn a Motion Pattern for Few-Shot Based Video Generation☆279Updated 10 months ago
- Official pytorch implementation of the paper: "An Edit Friendly DDPM Noise Space: Inversion and Manipulations". CVPR 2024.☆323Updated 8 months ago
- Code for Fast Training of Diffusion Models with Masked Transformers☆396Updated 9 months ago
- Scaling Diffusion Transformers with Mixture of Experts☆292Updated 6 months ago
- A collection of resources and papers on Vector Quantized Variational Autoencoder (VQ-VAE) and its application☆260Updated last month
- [ICML 2024 Spotlight] FiT: Flexible Vision Transformer for Diffusion Model☆406Updated 4 months ago
- Comparison between Frechet Video Distance implementation from StyleGAN-V and the original paper☆101Updated 2 months ago
- [NeurIPS 2024] CV-VAE: A Compatible Video VAE for Latent Generative Video Models☆267Updated 3 months ago
- Unofficial PyTorch implementation of the VideoLDM.☆153Updated last year
- Scalable Diffusion Models with State Space Backbone☆151Updated last year
- Official implementation of MCVD: Masked Conditional Video Diffusion for Prediction, Generation, and Interpolation (https://arxiv.org/abs/…☆337Updated 2 years ago
- Official implementation for "ControlVideo: Adding Conditional Control for One Shot Text-to-Video Editing"☆226Updated last year
- The official implementation for "Gen-L-Video: Multi-Text to Long Video Generation via Temporal Co-Denoising".☆295Updated last year
- ConsistI2V: Enhancing Visual Consistency for Image-to-Video Generation (TMLR 2024)☆239Updated 8 months ago
- PyTorch implementation of InstructDiffusion, a unifying and generic framework for aligning computer vision tasks with human instructions.☆417Updated 10 months ago