Haochen-Wang409 / ross
[ICLR 2025] Reconstructive Visual Instruction Tuning
☆73Updated 3 weeks ago
Alternatives and similar repositories for ross:
Users that are interested in ross are comparing it to the libraries listed below
- [NeurIPS 2024] Vision Model Pre-training on Interleaved Image-Text Data via Latent Compression Learning☆68Updated last month
- DenseFusion-1M: Merging Vision Experts for Comprehensive Multimodal Perception☆137Updated 3 months ago
- ☆115Updated 9 months ago
- Official repo for "Streaming Video Understanding and Multi-round Interaction with Memory-enhanced Knowledge" ICLR2025☆40Updated last week
- VL-GPT: A Generative Pre-trained Transformer for Vision and Language Understanding and Generation☆85Updated 6 months ago
- [CVPR'25] VideoEspresso: A Large-Scale Chain-of-Thought Dataset for Fine-Grained Video Reasoning via Core Frame Selection☆63Updated 3 weeks ago
- Empowering Unified MLLM with Multi-granular Visual Generation☆119Updated 2 months ago
- [arXiv: 2502.05178] QLIP: Text-Aligned Visual Tokenization Unifies Auto-Regressive Multimodal Understanding and Generation☆61Updated 3 weeks ago
- ☆18Updated 2 months ago
- (CVPR 2025) PyramidDrop: Accelerating Your Large Vision-Language Models via Pyramid Visual Redundancy Reduction☆80Updated 2 weeks ago
- [ICLR 2025] AuroraCap: Efficient, Performant Video Detailed Captioning and a New Benchmark☆84Updated 2 months ago
- A Comprehensive Benchmark and Toolkit for Evaluating Video-based Large Language Models!☆125Updated last year
- [ECCV 2024] ControlCap: Controllable Region-level Captioning☆73Updated 5 months ago
- 🌈 Unifying Visual Understanding and Generation with Dual Visual Vocabularies☆23Updated this week
- Official implementation of paper "SparseVLM: Visual Token Sparsification for Efficient Vision-Language Model Inference".☆80Updated 2 weeks ago
- The official repository for paper "PruneVid: Visual Token Pruning for Efficient Video Large Language Models".☆34Updated last month
- TemporalBench: Benchmarking Fine-grained Temporal Understanding for Multimodal Video Models☆29Updated 4 months ago
- ☆58Updated last year
- Official Implementation of ICLR'24: Kosmos-G: Generating Images in Context with Multimodal Large Language Models☆68Updated 10 months ago
- Official Pytorch implementation for LARP: Tokenizing Videos with a Learned Autoregressive Generative Prior (ICLR 2025 Oral).☆56Updated last month
- [Neurips 24' D&B] Official Dataloader and Evaluation Scripts for LongVideoBench.☆90Updated 7 months ago
- ☆29Updated 7 months ago
- ☆53Updated this week
- [CVPR 2025] 🔥 Official impl. of "TokenFlow: Unified Image Tokenizer for Multimodal Understanding and Generation".☆292Updated 3 weeks ago
- [NeurIPS 2024] Efficient Large Multi-modal Models via Visual Context Compression☆53Updated last month
- FreeVA: Offline MLLM as Training-Free Video Assistant☆57Updated 9 months ago
- ☆27Updated 2 months ago
- 👾 E.T. Bench: Towards Open-Ended Event-Level Video-Language Understanding (NeurIPS 2024)☆56Updated 2 months ago
- Official code for "What Makes for Good Visual Tokenizers for Large Language Models?".☆58Updated last year
- [CVPR 2025] PVC: Progressive Visual Token Compression for Unified Image and Video Processing in Large Vision-Language Models☆34Updated 3 weeks ago