ShareGPT4Omni / ShareGPT4Video
[NeurIPS 2024] An official implementation of ShareGPT4Video: Improving Video Understanding and Generation with Better Captions
☆1,032Updated 3 months ago
Alternatives and similar repositories for ShareGPT4Video:
Users that are interested in ShareGPT4Video are comparing it to the libraries listed below
- Vchitect-2.0: Parallel Transformer for Scaling Up Video Diffusion Models☆760Updated this week
- This is the official reproduction of FancyVideo.☆670Updated 2 months ago
- [ ICLR 2024 ] Official Codebase for "InstructCV: Instruction-Tuned Text-to-Image Diffusion Models as Vision Generalists"☆460Updated 9 months ago
- Region-Aware Text-to-Image Generation via Hard Binding and Soft Refinement 🔥☆530Updated 3 weeks ago
- The official repository for paper "Tora: Trajectory-oriented Diffusion Transformer for Video Generation"☆1,058Updated 3 weeks ago
- 🔥 Sa2VA: Marrying SAM2 with LLaVA for Dense Grounded Understanding of Images and Videos☆797Updated last week
- ☆758Updated last month
- Real-time and accurate open-vocabulary end-to-end object detection☆1,153Updated last month
- SAM2Long: Enhancing SAM 2 for Long Video Segmentation with a Training-Free Memory Tree☆448Updated last month
- [IJCV] Show-1: Marrying Pixel and Latent Diffusion Models for Text-to-Video Generation☆954Updated 2 months ago
- [ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization☆531Updated 7 months ago
- Video-Inpaint-Anything: This is the inference code for our paper CoCoCo: Improving Text-Guided Video Inpainting for Better Consistency, C…☆261Updated 4 months ago
- Align Anything: Training All-modality Model with Feedback☆938Updated this week
- MLLM for On-Demand Spatial-Temporal Understanding at Arbitrary Resolution☆279Updated last month
- [NeurIPS 2023] Official implementations for paper: Customizable Image Synthesis with Multiple Subjects☆425Updated last year
- Lyra: An Efficient and Speech-Centric Framework for Omni-Cognition☆271Updated 2 weeks ago
- The codes about "Uni-MoE: Scaling Unified Multimodal Models with Mixture of Experts"☆684Updated this week
- Pytorch Implementation of FLATTEN: optical FLow-guided ATTENtion for consistent text-to-video editing (ICLR 2024)☆206Updated 8 months ago
- (AAAI 2024) BLIVA: A Simple Multimodal LLM for Better Handling of Text-rich Visual Questions☆251Updated 9 months ago
- [CVPR 2024] Official code for "Text-Driven Image Editing via Learnable Regions"☆208Updated 4 months ago
- This project is the official implementation of 'LLMGA: Multimodal Large Language Model based Generation Assistant', ECCV2024 Oral☆385Updated 5 months ago
- Code for Paper "UniAnimate: Taming Unified Video Diffusion Models for Consistent Human Image Animation".☆1,031Updated 6 months ago
- a family of versatile and state-of-the-art video tokenizers.☆322Updated 2 weeks ago
- An open-source implementation for training LLaVA-NeXT.☆375Updated 3 months ago
- Unofficial Implementation of ReplaceAnything: https://aigcdesigngroup.github.io/replace-anything/☆400Updated 8 months ago
- OMG-LLaVA and OMG-Seg codebase [CVPR-24 and NeurIPS-24]☆1,214Updated last month
- Eagle Family: Exploring Model Designs, Data Recipes and Training Strategies for Frontier-Class Multimodal LLMs☆552Updated this week
- Evaluation of Text-to-Video Generation Models: A Dynamics Perspective[NeurIPS 2024].☆259Updated last month
- The code for "VideoRefer Suite: Advancing Spatial-Temporal Object Understanding with Video LLM"☆138Updated this week