yzxing87 / Seeing-and-Hearing
[CVPR 2024] Seeing and Hearing: Open-domain Visual-Audio Generation with Diffusion Latent Aligners
☆127Updated 4 months ago
Related projects ⓘ
Alternatives and complementary repositories for Seeing-and-Hearing
- Diff-Foley: Synchronized Video-to-Audio Synthesis with Latent Diffusion Models☆160Updated 5 months ago
- [ECCV 2024 Oral] Audio-Synchronized Visual Animation☆34Updated last month
- ☆21Updated this week
- [Arxiv 2024] Official code for MMTrail: A Multimodal Trailer Video Dataset with Language and Music Descriptions☆24Updated this week
- ☆30Updated 3 weeks ago
- This is the official implementation of 2024 CVPR paper "EmoGen: Emotional Image Content Generation with Text-to-Image Diffusion Models".☆56Updated 7 months ago
- Official PyTorch implementation of "Conditional Generation of Audio from Video via Foley Analogies".☆75Updated 11 months ago
- This repo contains the official PyTorch implementation of AudioToken: Adaptation of Text-Conditioned Diffusion Models for Audio-to-Image …☆76Updated 4 months ago
- UniEdit: A Unified Tuning-Free Framework for Video Motion and Appearance Editing☆90Updated this week
- ☆26Updated 3 months ago
- ☆14Updated 5 months ago
- STAR: Scale-wise Text-to-image generation via Auto-Regressive representations☆117Updated 4 months ago
- [CVPR 2024] EvalCrafter: Benchmarking and Evaluating Large Video Generation Models☆139Updated last month
- ConsistI2V: Enhancing Visual Consistency for Image-to-Video Generation (TMLR 2024)☆214Updated 4 months ago
- [Arxiv 2024] Official pytorch implementation of "VideoElevator: Elevating Video Generation Quality with Versatile Text-to-Image Diffusion…☆146Updated 7 months ago
- [NeurIPS 2024] CV-VAE: A Compatible Video VAE for Latent Generative Video Models☆239Updated last week
- ☆28Updated 3 weeks ago
- [ICLR 2024] LLM-grounded Video Diffusion Models (LVD): official implementation for the LVD paper☆126Updated 6 months ago
- [NeurIPS 2023] Free-Bloom: Zero-Shot Text-to-Video Generator with LLM Director and LDM Animator☆90Updated 7 months ago
- ☆94Updated 10 months ago
- ☆103Updated 8 months ago
- Ground-A-Video: Zero-shot Grounded Video Editing using Text-to-image Diffusion Models (ICLR 2024)☆130Updated 5 months ago
- ☆46Updated 3 months ago
- (CVPR 2024) 🧩 TokenCompose: Text-to-Image Diffusion with Token-level Supervision☆111Updated 3 weeks ago
- The official PyTorch implementation for Improving Long-Text Alignment for Text-to-Image Diffusion Models (LongAlign)☆54Updated 3 weeks ago
- ☆29Updated last month
- T2V-CompBench: A Comprehensive Benchmark for Compositional Text-to-video Generation☆46Updated 2 months ago
- [NeurIPS 2024] The official code of "U-DiTs: Downsample Tokens in U-Shaped Diffusion Transformers"☆111Updated last month
- Scaling Diffusion Transformers with Mixture of Experts☆202Updated 2 months ago
- ☆61Updated 5 months ago