[CVPR 2024] VCoder: Versatile Vision Encoders for Multimodal Large Language Models
☆279Apr 17, 2024Updated last year
Alternatives and similar repositories for VCoder
Users that are interested in VCoder are comparing it to the libraries listed below
Sorting:
- FleVRS: Towards Flexible Visual Relationship Segmentation, NeurIPS 2024☆22Dec 9, 2024Updated last year
- ☆644Feb 15, 2024Updated 2 years ago
- [CVPR2024] ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Prompts☆336Jul 17, 2024Updated last year
- LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills☆764Feb 1, 2024Updated 2 years ago
- [NeurIPS 2025] Elevating Visual Perception in Multimodal LLMs with Visual Embedding Distillation☆71Oct 17, 2025Updated 5 months ago
- [CVPR 2024 🔥] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses tha…☆949Aug 5, 2025Updated 7 months ago
- When do we not need larger vision models?☆415Feb 8, 2025Updated last year
- Code for experiments for "ConvNet vs Transformer, Supervised vs CLIP: Beyond ImageNet Accuracy"☆102Sep 11, 2024Updated last year
- Official Implementation of ICCV 2023 Paper - SegPrompt: Boosting Open-World Segmentation via Category-level Prompt Learning☆111May 28, 2025Updated 9 months ago
- PyTorch Implementation of "V* : Guided Visual Search as a Core Mechanism in Multimodal LLMs"☆696Jan 7, 2024Updated 2 years ago
- Emu Series: Generative Multimodal Models from BAAI☆1,772Jan 12, 2026Updated 2 months ago
- 【TMM 2025🔥】 Mixture-of-Experts for Large Vision-Language Models☆2,305Jul 15, 2025Updated 8 months ago
- ☆21Oct 10, 2023Updated 2 years ago
- [NeurIPS 2024] Official implementation of the paper "Interfacing Foundation Models' Embeddings"☆131Aug 21, 2024Updated last year
- Strong and Open Vision Language Assistant for Mobile Devices☆1,345Apr 15, 2024Updated last year
- Harnessing 1.4M GPT4V-synthesized Data for A Lite Vision-Language Model☆281Jun 25, 2024Updated last year
- A family of lightweight multimodal models.☆1,052Nov 18, 2024Updated last year
- Official implementation of 'CLIP-DINOiser: Teaching CLIP a few DINO tricks' paper.☆277Oct 26, 2024Updated last year
- ☆12Jan 10, 2025Updated last year
- [NeurIPS 2023] This repo contains the code for our paper Convolutions Die Hard: Open-Vocabulary Segmentation with Single Frozen Convoluti…☆339Feb 5, 2024Updated 2 years ago
- LLaMA-VID: An Image is Worth 2 Tokens in Large Language Models (ECCV 2024)☆860Jul 29, 2024Updated last year
- Cambrian-1 is a family of multimodal LLMs with a vision-centric design.☆1,990Nov 7, 2025Updated 4 months ago
- ☆4,591Sep 14, 2025Updated 6 months ago
- 【EMNLP 2024🔥】Video-LLaVA: Learning United Visual Representation by Alignment Before Projection☆3,463Dec 3, 2024Updated last year
- 🏞️ Official implementation of "Gen4Gen: Generative Data Pipeline for Generative Multi-Concept Composition"☆110Nov 24, 2025Updated 3 months ago
- InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions☆2,923May 26, 2025Updated 9 months ago
- [arXiv 2023] Set-of-Mark Prompting for GPT-4V and LMMs☆1,520Aug 19, 2024Updated last year
- Official repo of Griffon series including v1(ECCV 2024), v2(ICCV 2025), G, and R, and also the RL tool Vision-R1.☆249Aug 12, 2025Updated 7 months ago
- Python Library to evaluate VLM models' robustness across diverse benchmarks☆222Oct 20, 2025Updated 5 months ago
- [CVPR2024] The code for "Osprey: Pixel Understanding with Visual Instruction Tuning"☆836Aug 19, 2025Updated 7 months ago
- NeurIPS 2025 Spotlight; ICLR2024 Spotlight; CVPR 2024; EMNLP 2024☆1,824Nov 27, 2025Updated 3 months ago
- [CVPR 2024] SHAP-EDITOR: Instruction-guided Latent 3D Editing in Seconds☆36Jul 19, 2025Updated 8 months ago
- ☆134Dec 22, 2023Updated 2 years ago
- Official implementation for the paper "Prompt Pre-Training with Over Twenty-Thousand Classes for Open-Vocabulary Visual Recognition"☆259May 3, 2024Updated last year
- An Open-source Toolkit for LLM Development☆2,807Jan 13, 2025Updated last year
- ☆360Jan 27, 2024Updated 2 years ago
- [ICLR2025] LLaVA-HR: High-Resolution Large Language-Vision Assistant☆247Aug 14, 2024Updated last year
- Aligning LMMs with Factually Augmented RLHF☆393Nov 1, 2023Updated 2 years ago
- 【NeurIPS 2024】Dense Connector for MLLMs☆182Oct 14, 2024Updated last year