Oryx-mllm / Oryx
MLLM for On-Demand Spatial-Temporal Understanding at Arbitrary Resolution
☆286Updated this week
Related projects ⓘ
Alternatives and complementary repositories for Oryx
- SAM2Long: Enhancing SAM 2 for Long Video Segmentation with a Training-Free Memory Tree☆257Updated this week
- [NeurIPS 2024]OmniTokenizer: one model and one weight for image-video joint tokenization.☆256Updated 4 months ago
- [ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization☆558Updated 5 months ago
- [ECCV 2024] Bridging Different Language Models and Generative Vision Models for Text-to-Image Generation☆313Updated 3 months ago
- SaRA: High-Efficient Diffusion Model Fine-tuning with Progressive Sparse Low-Rank Adaptation☆97Updated 3 weeks ago
- Vchitect-2.0: Parallel Transformer for Scaling Up Video Diffusion Models☆639Updated last month
- Evaluating text-to-image/video/3D models with VQAScore☆223Updated 2 months ago
- ☆365Updated 6 months ago
- The code for "TokenPacker: Efficient Visual Projector for Multimodal LLM".☆211Updated 3 weeks ago
- The official code for "BiGR: Harnessing Binary Latent Codes for Image Generation and Improved Visual Representation Capabilities"☆150Updated 2 weeks ago
- An open-source implementation for training LLaVA-NeXT.☆390Updated 2 weeks ago
- This project is the official implementation of 'LLMGA: Multimodal Large Language Model based Generation Assistant', ECCV2024 Oral☆459Updated 3 months ago
- EAGLE: Exploring The Design Space for Multimodal LLMs with Mixture of Encoders☆535Updated last month
- Video-Inpaint-Anything: This is the inference code for our paper CoCoCo: Improving Text-Guided Video Inpainting for Better Consistency, C…☆280Updated last month
- Visualization of DiT self attention features☆152Updated 3 months ago
- Official implementation for "Identifying and Solving Conditional Image Leakage in Image-to-Video Diffusion Model" (NeurIPS 2024)☆288Updated 3 weeks ago
- [NeurIPS 2024] An official implementation of ShareGPT4Video: Improving Video Understanding and Generation with Better Captions☆1,260Updated last month
- [NeurIPS 2024 D&B Spotlight🔥] ChronoMagic-Bench: A Benchmark for Metamorphic Evaluation of Text-to-Time-lapse Video Generation☆184Updated last week
- [CVPR 2024] Focus on Your Instruction: Fine-grained and Multi-instruction Image Editing by Attention Modulation☆103Updated 7 months ago
- This is the official reproduction of FancyVideo.☆798Updated last week
- Official implementation of Bootstrap3D: Improving Multi-view Diffusion Model with Synthetic Data☆84Updated 2 weeks ago
- This is the official reproduction of Qihoo-T2X.☆243Updated last week
- Pytorch Implementation of FLATTEN: optical FLow-guided ATTENtion for consistent text-to-video editing (ICLR 2024)☆207Updated 5 months ago
- Code release for "UniVS: Unified and Universal Video Segmentation with Prompts as Queries" (CVPR2024)☆165Updated 4 months ago
- Chain-of-Spot: Interactive Reasoning Improves Large Vision-language Models☆86Updated 7 months ago
- ☆355Updated 4 months ago
- [ECCV 2024] Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?☆148Updated last month
- GPT4Vis: What Can GPT-4 Do for Zero-shot Visual Recognition?☆207Updated 5 months ago
- (ECCV 2024) Empowering Multimodal Large Language Model as a Powerful Data Generator☆108Updated 3 weeks ago
- Codes for ID-Specific Video Customized Diffusion☆459Updated 8 months ago