Oryx-mllm / Oryx
[ICLR 2025] MLLM for On-Demand Spatial-Temporal Understanding at Arbitrary Resolution
☆302Updated last month
Alternatives and similar repositories for Oryx:
Users that are interested in Oryx are comparing it to the libraries listed below
- [CVPR 2025] The code for "VideoRefer Suite: Advancing Spatial-Temporal Object Understanding with Video LLM"☆185Updated 2 weeks ago
- a family of versatile and state-of-the-art video tokenizers.☆380Updated 2 weeks ago
- ☆226Updated 4 months ago
- Liquid: Language Models are Scalable and Unified Multi-modal Generators☆368Updated last week
- [ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization☆559Updated 10 months ago
- [NeurIPS 2024]OmniTokenizer: one model and one weight for image-video joint tokenization.☆293Updated 9 months ago
- ☆87Updated last week
- Official implementation of X-Prompt: Towards Universal In-Context Image Generation in Auto-Regressive Vision Language Foundation Models☆154Updated 4 months ago
- GPT-ImgEval: Evaluating GPT-4o’s state-of-the-art image generation capabilities☆230Updated last week
- ☆380Updated 4 months ago
- SaRA: High-Efficient Diffusion Model Fine-tuning with Progressive Sparse Low-Rank Adaptation☆112Updated 6 months ago
- SAM2Long: Enhancing SAM 2 for Long Video Segmentation with a Training-Free Memory Tree☆462Updated 4 months ago
- An official implementation of VideoRoPE: What Makes for Good Video Rotary Position Embedding?☆126Updated last week
- Evaluating text-to-image/video/3D models with VQAScore☆283Updated last month
- This project is the official implementation of 'LLMGA: Multimodal Large Language Model based Generation Assistant', ECCV2024 Oral☆394Updated 8 months ago
- [ECCV 2024] Bridging Different Language Models and Generative Vision Models for Text-to-Image Generation☆290Updated 9 months ago
- An open-source implementation for training LLaVA-NeXT.☆391Updated 5 months ago
- ✨✨Long-VITA: Scaling Large Multi-modal Models to 1 Million Tokens with Leading Short-Context Accuracy☆272Updated 3 weeks ago
- [ICLR 2025] BiGR: Harnessing Binary Latent Codes for Image Generation and Improved Visual Representation Capabilities☆140Updated 2 months ago
- Ola: Pushing the Frontiers of Omni-Modal Language Model☆334Updated last month
- [CVPR 2025] The First Investigation of CoT Reasoning in Image Generation☆620Updated 2 weeks ago
- A post-training method to enhance CLIP's fine-grained visual representations with generative models.☆47Updated 3 weeks ago
- The code for "TokenPacker: Efficient Visual Projector for Multimodal LLM".☆246Updated 3 months ago
- [NeurIPS 2024] An official implementation of ShareGPT4Video: Improving Video Understanding and Generation with Better Captions☆1,053Updated 6 months ago
- Official Implementation for "Lyra: An Efficient and Speech-Centric Framework for Omni-Cognition"☆283Updated 3 months ago
- ☆134Updated 3 months ago
- Official implementation for "Identifying and Solving Conditional Image Leakage in Image-to-Video Diffusion Model" (NeurIPS 2024)☆252Updated 5 months ago
- Official code base for paper EZIGen: Enhancing zero-shot personalized image generation with precise subject encoding and decoupled guidan…☆104Updated 3 weeks ago
- Video-Inpaint-Anything: This is the inference code for our paper CoCoCo: Improving Text-Guided Video Inpainting for Better Consistency, C…☆288Updated 6 months ago
- [ECCV 2024] Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?☆159Updated 6 months ago