Yuan-ManX / ai-multimodal-timeline
Here we will track the latest AI Multimodal Models, including Multimodal Foundation Models, LLM, Agent, Audio, Image, Video, Music and 3D content. 🔥
☆31Updated this week
Related projects ⓘ
Alternatives and complementary repositories for ai-multimodal-timeline
- Web2Code: A Large-scale Webpage-to-Code Dataset and Evaluation Framework for Multimodal LLMs☆62Updated 3 weeks ago
- ☆21Updated this week
- ☆120Updated 2 months ago
- Official GPU implementation of the paper "PPLLaVA: Varied Video Sequence Understanding With Prompt Guidance"☆94Updated this week
- An open source community implementation of the model from the paper: "Movie Gen: A Cast of Media Foundation Models". Join our community …☆55Updated this week
- The codes of Siggraph Asia 2024 paper "Anim-Director: A Large Multimodal Model Powered Agent for Controllable Animation Video Generation"☆33Updated 2 months ago
- Offical implementation of the paper "MagicTailor: Component-Controllable Personalization in Text-to-Image Diffusion Models".☆68Updated 2 weeks ago
- Live2Diff: A Pipeline that processes Live video streams by a uni-directional video Diffusion model.☆167Updated 3 months ago
- faster parallel inference of mochi-1 video generation model☆73Updated last week
- Implementation of SmoothCache, a project aimed at speeding-up Diffusion Transformer (DiT) based GenAI models with error-guided caching.☆18Updated this week
- A Training-free Iterative Framework for Long Story Visualization☆62Updated this week
- A one-stop library to standardize the inference and evaluation of all the conditional video generation models.☆43Updated 2 weeks ago
- Code for Paper: Harnessing Webpage Uis For Text Rich Visual Understanding☆38Updated last month
- A streamlined implementation of Grounding DINO and SAM for advanced image segmentation. This lightweight solution simplifies the integrat…☆63Updated last month
- IterComp: Iterative Composition-Aware Feedback Learning from Model Gallery for Text-to-Image Generation☆138Updated 3 weeks ago
- Official implementation of the paper "MMInA: Benchmarking Multihop Multimodal Internet Agents"☆38Updated 7 months ago
- A Framework for Decoupling and Assessing the Capabilities of VLMs☆38Updated 4 months ago
- Implementation of the premier Text to Video model from OpenAI☆57Updated last week
- Official PyTorch Implementation of "FlowTurbo: Towards Real-time Flow-Based Image Generation with Velocity Refiner"☆60Updated last month
- Recaption large (Web)Datasets with vllm and save the artifacts.☆30Updated last month
- SkyScript-100M: 1,000,000,000 Pairs of Scripts and Shooting Scripts for Short Drama: https://arxiv.org/abs/2408.09333v2☆99Updated this week
- Video-Infinity generates long videos quickly using multiple GPUs without extra training.☆164Updated 3 months ago
- Training-and-pormpt Free General Painterly Image Harmonization Using image-wise attention sharing☆52Updated 5 months ago
- [NeurIPS 2024] Official Implementation for Optimus-1: Hybrid Multimodal Memory Empowered Agents Excel in Long-Horizon Tasks☆25Updated last month
- sd3 dreambooth lora training book, adapted from the diffusers doc☆42Updated 5 months ago
- ☆78Updated 3 months ago
- ☆145Updated 2 months ago
- FLUX.1-dev LoRA Outfit Generator can create an outfit by detailing the color, pattern, fit, style, material, and type.☆42Updated 2 weeks ago
- Pytorch implementation of MIMO, Controllable Character Video Synthesis with Spatial Decomposed Modeling, from Alibaba Intelligence Group☆127Updated last month
- Video-LlaVA fine-tune for CinePile evaluation☆38Updated 3 months ago