snap-research / AVLinkLinks
AV-Link: Temporally-Aligned Diffusion Features for Cross-Modal Audio-Video Generation
☆15Updated 6 months ago
Alternatives and similar repositories for AVLink
Users that are interested in AVLink are comparing it to the libraries listed below
Sorting:
- ☆38Updated 2 months ago
- This repo contains the official PyTorch implementation of vLMIG: Improving Visual Commonsense in Language Models via Multiple Image Gener…☆16Updated 11 months ago
- AliTok: Towards Sequence Modeling Alignment between Tokenizer and Autoregressive Model☆29Updated last week
- This repo contains the official PyTorch implementation of AudioToken: Adaptation of Text-Conditioned Diffusion Models for Audio-to-Image …☆84Updated last year
- ACDiT: Interpolating Autoregressive Conditional Modeling and Diffusion Transformer☆34Updated 6 months ago
- Official code for the paper: [ICCV2023] Sound Localization from Motion: Jointly Learning Sound Direction and Camera Rotation☆39Updated last year
- Action2Sound: Ambient-Aware Generation of Action Sounds from Egocentric Videos☆21Updated 8 months ago
- HermesFlow: Seamlessly Closing the Gap in Multimodal Understanding and Generation☆63Updated 4 months ago
- ☆9Updated 9 months ago
- ☆17Updated 2 years ago
- An official pytorch implementation of AAAI 2024 paper "Latent Space Editing in Transformer-based Flow Matching"☆42Updated last year
- [ICLR2022] Code for "Retriever: Learning Content-Style Representation as a Token-Level Bipartite Graph"☆54Updated 2 years ago
- ☆11Updated 11 months ago
- Long-Term Rhythmic Video Soundtracker, ICML2023☆59Updated 11 months ago
- ☆23Updated 8 months ago
- MaskFlow: Discrete Flows For Flexible and Efficient Long Video Generation☆24Updated 3 months ago
- This repository is for The Power of Sound(TPoS): Audio Reactive Video Generation with Stable Diffusion (ICCV2023)☆23Updated last year
- LVAS-Agent Code Base☆20Updated 2 months ago
- Diff-TTSG: Denoising probabilistic integrated speech and gesture synthesis☆39Updated last year
- Boosting Generative Image Modeling via Joint Image-Feature Synthesis☆44Updated last week
- DDS: Delta Denoising Score PyTorch implementation☆19Updated last year
- (wip) Use LAION-AI's CLIP "conditoned prior" to generate CLIP image embeds from CLIP text embeds.☆27Updated 2 years ago
- [ECCV 2024 Oral] Audio-Synchronized Visual Animation☆52Updated 9 months ago
- Code and Data for Paper: SELMA: Learning and Merging Skill-Specific Text-to-Image Experts with Auto-Generated Data☆34Updated last year
- Official repo for the TMLR paper "Discffusion: Discriminative Diffusion Models as Few-shot Vision and Language Learners"☆29Updated last year
- ☆16Updated last year
- UnifiedMLLM: Enabling Unified Representation for Multi-modal Multi-tasks With Large Language Model☆22Updated 10 months ago
- A big_vision inspired repo that implements a generic Auto-Encoder class capable in representation learning and generative modeling.☆35Updated last year
- Official implementation of "VSTAR: Generative Temporal Nursing for Longer Dynamic Video Synthesis"☆19Updated 5 months ago
- [ACCV 2024] Official Implementation of "AutoAD-Zero: A Training-Free Framework for Zero-Shot Audio Description". Junyu Xie, Tengda Han, M…☆25Updated 5 months ago