2toinf / IVM
[NeurIPS-2024] The offical Implementation of "Instruction-Guided Visual Masking"
☆33Updated 3 months ago
Alternatives and similar repositories for IVM:
Users that are interested in IVM are comparing it to the libraries listed below
- ☆66Updated 2 months ago
- ☆36Updated 2 months ago
- Egocentric Video Understanding Dataset (EVUD)☆26Updated 7 months ago
- Official implementation of: Bootstrapping Language-Guided Navigation Learning with Self-Refining Data Flywheel☆18Updated 2 months ago
- (NeurIPS 2024) What Makes CLIP More Robust to Long-Tailed Pre-Training Data? A Controlled Study for Transferable Insights☆24Updated 4 months ago
- [NeurIPS 2024] Official code for HourVideo: 1-Hour Video Language Understanding☆66Updated last month
- Can 3D Vision-Language Models Truly Understand Natural Language?☆21Updated 11 months ago
- Official repository of S-Agents: Self-organizing Agents in Open-ended Environment☆21Updated 11 months ago
- [ICML 2024] The offical Implementation of "DecisionNCE: Embodied Multimodal Representations via Implicit Preference Learning"☆76Updated 5 months ago
- Latent Motion Token as the Bridging Language for Robot Manipulation☆74Updated 3 weeks ago
- ☆44Updated 2 months ago
- TemporalBench: Benchmarking Fine-grained Temporal Understanding for Multimodal Video Models☆28Updated 3 months ago
- [CVPR2024] This is the official implement of MP5☆96Updated 8 months ago
- Emerging Pixel Grounding in Large Multimodal Models Without Grounding Supervision☆31Updated 4 months ago
- ☆65Updated last month
- ☆45Updated 10 months ago
- Official repository of DoraemonGPT: Toward Understanding Dynamic Scenes with Large Language Models☆82Updated 6 months ago
- VideoNIAH: A Flexible Synthetic Method for Benchmarking Video MLLMs☆39Updated this week
- Official implementation for CoVLM: Composing Visual Entities and Relationships in Large Language Models Via Communicative Decoding☆44Updated last year
- Awesome paper for multi-modal llm with grounding ability☆15Updated 7 months ago
- [NeurIPS 2024] Official Repository of Multi-Object Hallucination in Vision-Language Models☆27Updated 3 months ago
- A comprehensive list of papers for the definition of World Models and using World Models for General Video Generation, Embodied AI, and A…☆75Updated this week
- [NeurIPS 2024] Calibrated Self-Rewarding Vision Language Models☆68Updated 8 months ago
- [ECCV 2024] AdaNAT: Exploring Adaptive Policy for Token-Based Image Generation☆33Updated 5 months ago
- Emma-X: An Embodied Multimodal Action Model with Grounded Chain of Thought and Look-ahead Spatial Reasoning☆45Updated last month
- [NeurIPS2024] Official code for (IMA) Implicit Multimodal Alignment: On the Generalization of Frozen LLMs to Multimodal Inputs☆17Updated 4 months ago
- IMProv: Inpainting-based Multimodal Prompting for Computer Vision Tasks☆59Updated 5 months ago