Oryx-mllm / Oryx
[ICLR 2025] MLLM for On-Demand Spatial-Temporal Understanding at Arbitrary Resolution
☆297Updated last month
Alternatives and similar repositories for Oryx:
Users that are interested in Oryx are comparing it to the libraries listed below
- [CVPR 2025] The code for "VideoRefer Suite: Advancing Spatial-Temporal Object Understanding with Video LLM"☆177Updated this week
- a family of versatile and state-of-the-art video tokenizers.☆354Updated this week
- Liquid: Language Models are Scalable and Unified Multi-modal Generators☆288Updated this week
- ☆223Updated 3 months ago
- [ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization☆555Updated 9 months ago
- [NeurIPS 2024]OmniTokenizer: one model and one weight for image-video joint tokenization.☆285Updated 8 months ago
- SaRA: High-Efficient Diffusion Model Fine-tuning with Progressive Sparse Low-Rank Adaptation☆112Updated 5 months ago
- Investigating CoT Reasoning in Autoregressive Image Generation☆559Updated this week
- SAM2Long: Enhancing SAM 2 for Long Video Segmentation with a Training-Free Memory Tree☆459Updated 3 months ago
- Official implementation of X-Prompt: Towards Universal In-Context Image Generation in Auto-Regressive Vision Language Foundation Models☆152Updated 3 months ago
- [ECCV 2024] Bridging Different Language Models and Generative Vision Models for Text-to-Image Generation☆291Updated 8 months ago
- Evaluating text-to-image/video/3D models with VQAScore☆266Updated last week
- An official implementation of VideoRoPE: What Makes for Good Video Rotary Position Embedding?☆112Updated 3 weeks ago
- The code for "TokenPacker: Efficient Visual Projector for Multimodal LLM".☆241Updated 3 months ago
- Ola: Pushing the Frontiers of Omni-Modal Language Model☆319Updated 3 weeks ago
- ☆377Updated 3 months ago
- An open-source implementation for training LLaVA-NeXT.☆385Updated 5 months ago
- [ICLR 2025] BiGR: Harnessing Binary Latent Codes for Image Generation and Improved Visual Representation Capabilities☆139Updated 2 months ago
- This project is the official implementation of 'LLMGA: Multimodal Large Language Model based Generation Assistant', ECCV2024 Oral☆391Updated 7 months ago
- Official implementation for "Identifying and Solving Conditional Image Leakage in Image-to-Video Diffusion Model" (NeurIPS 2024)☆252Updated 5 months ago
- ✨✨Long-VITA: Scaling Large Multi-modal Models to 1 Million Tokens with Leading Short-Context Accuracy☆263Updated last week
- Lyra: An Efficient and Speech-Centric Framework for Omni-Cognition☆282Updated 2 months ago
- ☆132Updated 2 months ago
- The repository for the paper titled "Leopard: A Vision Language Model For Text-Rich Multi-Image Tasks"☆154Updated 3 months ago
- Official code base for paper EZIGen: Enhancing zero-shot personalized image generation with precise subject encoding and decoupled guidan…☆102Updated this week
- (ECCV 2024) Empowering Multimodal Large Language Model as a Powerful Data Generator☆107Updated this week
- [NeurIPS 2024 D&B Spotlight🔥] ChronoMagic-Bench: A Benchmark for Metamorphic Evaluation of Text-to-Time-lapse Video Generation☆191Updated last month
- Eagle Family: Exploring Model Designs, Data Recipes and Training Strategies for Frontier-Class Multimodal LLMs☆635Updated last month
- Pytorch Implementation of FLATTEN: optical FLow-guided ATTENtion for consistent text-to-video editing (ICLR 2024)☆205Updated 10 months ago
- Chain-of-Spot: Interactive Reasoning Improves Large Vision-language Models☆92Updated last year