a family of highly capabale yet efficient large multimodal models
☆195Aug 23, 2024Updated last year
Alternatives and similar repositories for imp
Users that are interested in imp are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆400Dec 12, 2024Updated last year
- A Framework of Small-scale Large Multimodal Models☆1,002Jul 23, 2026Updated 2 weeks ago
- Harnessing 1.4M GPT4V-synthesized Data for A Lite Vision-Language Model☆281Jun 25, 2024Updated 2 years ago
- Strong and Open Vision Language Assistant for Mobile Devices☆1,368Apr 15, 2024Updated 2 years ago
- ☆57Jan 23, 2024Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Enable everyone to develop, optimize and deploy AI models natively on everyone's devices.☆14May 29, 2024Updated 2 years ago
- When do we not need larger vision models?☆419Feb 8, 2025Updated last year
- A family of lightweight multimodal models.☆1,053Nov 18, 2024Updated last year
- Official Implementation for "MyVLM: Personalizing VLMs for User-Specific Queries" (ECCV 2024)☆188Jul 5, 2024Updated 2 years ago
- Official code of *Virgo: A Preliminary Exploration on Reproducing o1-like MLLM*☆110May 27, 2025Updated last year
- Official code implementation of Vary-toy (Small Language Model Meets with Reinforced Vision Vocabulary)☆630Dec 30, 2024Updated last year
- [TMLR] Public code repo for paper "A Single Transformer for Scalable Vision-Language Modeling"☆150Nov 14, 2024Updated last year
- 【NeurIPS 2024】Dense Connector for MLLMs☆182Oct 14, 2024Updated last year
- A PyTorch implementation of the paper Multimodal Transformer with Multiview Visual Representation for Image Captioning☆25Sep 4, 2020Updated 5 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- VisionLLaMA: A Unified LLaMA Backbone for Vision Tasks☆392Jul 9, 2024Updated 2 years ago
- mPLUG-HalOwl: Multimodal Hallucination Evaluation and Mitigating☆100Jan 29, 2024Updated 2 years ago
- The code for "TokenPacker: Efficient Visual Projector for Multimodal LLM", IJCV2025☆279May 26, 2025Updated last year
- 【TMM 2025🔥】 Mixture-of-Experts for Large Vision-Language Models☆2,322Jul 15, 2025Updated last year
- TinyGPT-V: Efficient Multimodal Large Language Model via Small Backbones☆1,315Feb 5, 2026Updated 6 months ago
- ☆37Sep 16, 2024Updated last year
- ☆35Jan 21, 2025Updated last year
- [NeurIPS 2025] Elevating Visual Perception in Multimodal LLMs with Visual Embedding Distillation☆74Oct 17, 2025Updated 9 months ago
- EVE Series: Encoder-Free Vision-Language Models from BAAI☆376Jul 24, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- [NeurIPS 2024] MoVA: Adapting Mixture of Vision Experts to Multimodal Context☆174Sep 25, 2024Updated last year
- [NeurIPS 2024] Official implementation of the paper "Interfacing Foundation Models' Embeddings"☆132Aug 21, 2024Updated last year
- [Technical Report] Official PyTorch implementation code for realizing the technical part of Phantom of Latent representing equipped with …☆63Oct 9, 2024Updated last year
- LLaVA-UHD v3: Progressive Visual Compression for Efficient Native-Resolution Encoding in MLLMs☆423Jul 6, 2026Updated last month
- MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilities (ICML 2024)☆332Jan 20, 2025Updated last year
- ☆81Nov 24, 2024Updated last year
- This repository provides the code and model checkpoints for AIMv1 and AIMv2 research projects.☆1,424Aug 4, 2025Updated last year
- Python Library to evaluate VLM models' robustness across diverse benchmarks☆227Jun 30, 2026Updated last month
- [CVPR 2024 🔥] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses tha…☆967Aug 5, 2025Updated last year
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Implementation of ICCV 2025 paper "Growing a Twig to Accelerate Large Vision-Language Models".☆31May 23, 2026Updated 2 months ago
- ROSITA: Enhancing Vision-and-Language Semantic Alignments via Cross- and Intra-modal Knowledge Integration☆57Jun 13, 2023Updated 3 years ago
- Official repository for the paper PLLaVA☆670Jul 28, 2024Updated 2 years ago
- [ICLR 2024 & ECCV 2024] The All-Seeing Projects: Towards Panoptic Visual Recognition&Understanding and General Relation Comprehension of …☆506Aug 9, 2024Updated 2 years ago
- [ICML'24] The official implementation of “Rethinking Optimization and Architecture for Tiny Language Models”☆126Jan 14, 2025Updated last year
- ☆223Jul 5, 2024Updated 2 years ago
- [CVPR'24] RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedback☆310Sep 11, 2024Updated last year