ShareGPT4Omni / ShareGPT4Video
[NeurIPS 2024] An official implementation of ShareGPT4Video: Improving Video Understanding and Generation with Better Captions
☆1,052Updated 5 months ago
Alternatives and similar repositories for ShareGPT4Video:
Users that are interested in ShareGPT4Video are comparing it to the libraries listed below
- Vchitect-2.0: Parallel Transformer for Scaling Up Video Diffusion Models☆908Updated 2 weeks ago
- Ola: Pushing the Frontiers of Omni-Modal Language Model☆320Updated last month
- Video generation from text&image, 1st-gen☆842Updated last month
- [ ICLR 2024 ] Official Codebase for "InstructCV: Instruction-Tuned Text-to-Image Diffusion Models as Vision Generalists"☆462Updated 11 months ago
- 🔥 Sa2VA: Marrying SAM2 with LLaVA for Dense Grounded Understanding of Images and Videos☆991Updated 2 weeks ago
- [CVPR'25]Tora: Trajectory-oriented Diffusion Transformer for Video Generation☆1,110Updated last month
- [CVPR 2025] The First Investigation of CoT Reasoning in Image Generation☆575Updated last week
- [ICLR 2025] MLLM for On-Demand Spatial-Temporal Understanding at Arbitrary Resolution☆301Updated last month
- [ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization☆554Updated 9 months ago
- Video-Inpaint-Anything: This is the inference code for our paper CoCoCo: Improving Text-Guided Video Inpainting for Better Consistency, C…☆281Updated 6 months ago
- Region-Aware Text-to-Image Generation via Hard Binding and Soft Refinement 🔥☆555Updated 2 months ago
- [IJCV] Show-1: Marrying Pixel and Latent Diffusion Models for Text-to-Video Generation☆1,072Updated 4 months ago
- ☆826Updated 3 months ago
- This project is the official implementation of 'LLMGA: Multimodal Large Language Model based Generation Assistant', ECCV2024 Oral☆389Updated 7 months ago
- Official Implementation for "Lyra: An Efficient and Speech-Centric Framework for Omni-Cognition"☆282Updated 2 months ago
- Official implementation for "RIFLEx: A Free Lunch for Length Extrapolation in Video Diffusion Transformers"☆515Updated last month
- [CVPR 2024] Aligning and Prompting Everything All at Once for Universal Visual Perception☆556Updated 10 months ago
- a family of versatile and state-of-the-art video tokenizers.☆355Updated last week
- [NeurIPS 2023] Official implementations for paper: Customizable Image Synthesis with Multiple Subjects☆431Updated last year
- (AAAI 2024) BLIVA: A Simple Multimodal LLM for Better Handling of Text-rich Visual Questions☆256Updated 11 months ago
- SAM2Long: Enhancing SAM 2 for Long Video Segmentation with a Training-Free Memory Tree☆460Updated 3 months ago
- Liquid: Language Models are Scalable and Unified Multi-modal Generators☆333Updated last week
- [CVPR 2025🔥] Identity-Preserving Text-to-Video Generation by Frequency Decomposition☆656Updated this week
- Efficient DiT architecture for text2any tasks, ICLR2025☆406Updated last month
- An open-source implementation for training LLaVA-NeXT.☆386Updated 5 months ago
- Pytorch Implementation of FLATTEN: optical FLow-guided ATTENtion for consistent text-to-video editing (ICLR 2024)☆205Updated 10 months ago
- Code for SCIS-2025 Paper "UniAnimate: Taming Unified Video Diffusion Models for Consistent Human Image Animation".☆1,062Updated 8 months ago
- The codes about "Uni-MoE: Scaling Unified Multimodal Models with Mixture of Experts"☆709Updated this week
- Real-time and accurate open-vocabulary end-to-end object detection☆1,307Updated 3 months ago
- Hallo3: Highly Dynamic and Realistic Portrait Image Animation with Video Diffusion Transformer☆1,162Updated 3 weeks ago