kaleido-lab / dolphin
General video interaction platform based on LLMs, including Video ChatGPT
☆252Updated last year
Related projects ⓘ
Alternatives and complementary repositories for dolphin
- BindDiffusion: One Diffusion Model to Bind Them All☆162Updated last year
- [ICLR 2024 Spotlight] DreamLLM: Synergistic Multimodal Comprehension and Creation☆391Updated 6 months ago
- Official Repository of ChatCaptioner☆452Updated last year
- Retrieval-Augmented Video Generation for Telling a Story☆249Updated 9 months ago
- VideoLLM: Modeling Video Sequence with Large Language Models☆154Updated last year
- VCoder: Versatile Vision Encoders for Multimodal Large Language Models, arXiv 2023 / CVPR 2024☆261Updated 6 months ago
- PG-Video-LLaVA: Pixel Grounding in Large Multimodal Video Models☆242Updated 10 months ago
- Code for Text2Performer. Paper: Text2Performer: Text-Driven Human Video Generation☆323Updated last year
- ☆153Updated last year
- Generate image from anything with ImageBind and Stable Diffusion☆192Updated last year
- ☆65Updated last year
- Relate Anything Model is capable of taking an image as input and utilizing SAM to identify the corresponding mask within the image.☆441Updated last year
- ☆81Updated last year
- Long Context Transfer from Language to Vision☆328Updated 2 weeks ago
- [SIGGRAPH Asia 2023] An interactive story visualization tool that support multiple characters☆253Updated 7 months ago
- [TMLR23] Official implementation of UnIVAL: Unified Model for Image, Video, Audio and Language Tasks.☆224Updated 10 months ago
- Official repo for StableLLAVA☆90Updated 10 months ago
- The official implementation for "Gen-L-Video: Multi-Text to Long Video Generation via Temporal Co-Denoising".☆285Updated 10 months ago
- EILeV: Eliciting In-Context Learning in Vision-Language Models for Videos Through Curated Data Distributional Properties☆117Updated last week
- LLaVA-Interactive-Demo☆351Updated 3 months ago
- 🐙Octopus, an embodied vision-language model trained with RLEF, emerging superior in embodied visual planning and programming.☆264Updated 5 months ago
- ControlLLM: Augment Language Models with Tools by Searching on Graphs☆186Updated 3 months ago
- Subject-Diffusion:Open Domain Personalized Text-to-Image Generation without Test-time Fine-tuning☆284Updated 4 months ago
- [NeurIPS'23] "MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editing".☆307Updated 5 months ago
- Official implementation of SEED-LLaMA (ICLR 2024).☆574Updated last month
- ☆164Updated 4 months ago
- A new multi-shot video understanding benchmark Shot2Story with comprehensive video summaries and detailed shot-level captions.☆98Updated last month
- [IEEE TVCG 2024] Customized Video Generation Using Textual and Structural Guidance☆184Updated 8 months ago
- [CVPR 2024] Prompt Highlighter: Interactive Control for Multi-Modal LLMs☆132Updated 3 months ago
- Implementation of DragDiffusion: Harnessing Diffusion Models for Interactive Point-based Image Editing☆227Updated last year