EvolvingLMMs-Lab / Aero-1Links
☆78Updated 7 months ago
Alternatives and similar repositories for Aero-1
Users that are interested in Aero-1 are comparing it to the libraries listed below
Sorting:
- video-SALMONN 2 is a powerful audio-visual large language model (LLM) that generates high-quality audio-visual video captions, which is d…☆123Updated last month
- Official code of the paper: Draw an Audio: Leveraging Multi-Instruction for Video-to-Audio Synthesis.☆45Updated last year
- ☆92Updated last year
- The official implementation of OmniFlow: Any-to-Any Generation with Multi-Modal Rectified Flows☆119Updated 3 months ago
- Kling-Foley: Multimodal Diffusion Transformer for High-Quality Video-to-Audio Generation☆61Updated 5 months ago
- ☆80Updated 8 months ago
- Official PyTorch implementation of TokenSet.☆127Updated 8 months ago
- ☆130Updated 5 months ago
- ACDiT: Interpolating Autoregressive Conditional Modeling and Diffusion Transformer☆38Updated 11 months ago
- ☆27Updated 8 months ago
- LVAS-Agent Code Base☆21Updated 7 months ago
- Multimodal Representation Alignment for Image Generation: Text-Image Interleaved Control Is Easier Than You Think!☆120Updated 9 months ago
- Towards Fine-grained Audio Captioning with Multimodal Contextual Cues☆84Updated 2 months ago
- The official PyTorch implementation for Improving Long-Text Alignment for Text-to-Image Diffusion Models (LongAlign)☆80Updated 7 months ago
- Implementation of the proposed MaskBit from Bytedance AI☆83Updated last year
- AudioStory: Generating Long-Form Narrative Audio with Large Language Models☆289Updated 2 months ago
- [Arxiv 2024] Official code for MMTrail: A Multimodal Trailer Video Dataset with Language and Music Descriptions☆33Updated 10 months ago
- An official implementation of SwapAnyone.☆71Updated 8 months ago
- LLaVA combines with Magvit Image tokenizer, training MLLM without an Vision Encoder. Unifying image understanding and generation.☆37Updated last year
- ☆181Updated 9 months ago
- [NeurIPS 2024] Official PyTorch Implementation of "FlowTurbo: Towards Real-time Flow-Based Image Generation with Velocity Refiner"☆70Updated last month
- ☆141Updated 4 months ago
- EchoX: Towards Mitigating Acoustic-Semantic Gap via Echo Training for Speech-to-Speech LLMs☆41Updated 2 months ago
- OmniVinci is an omni-modal LLM for joint understanding of vision, audio, and language.☆591Updated last month
- ☆83Updated last month
- A unified framework for controllable caption generation across images, videos, and audio. Supports multi-modal inputs and customizable ca…☆52Updated 4 months ago
- Quick Long Video Understanding☆70Updated last month
- AliTok: Towards Sequence Modeling Alignment between Tokenizer and Autoregressive Model☆49Updated last month
- ☆62Updated 5 months ago
- ☆139Updated last year