a family of highly capabale yet efficient large multimodal models
☆194Aug 23, 2024Updated 2 years ago
Alternatives and similar repositories for imp
Users that are interested in imp are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆400Dec 12, 2024Updated last year
- A Framework of Small-scale Large Multimodal Models☆1,010Oct 19, 2026Updated last month
- Harnessing 1.4M GPT4V-synthesized Data for A Lite Vision-Language Model☆282Jun 25, 2024Updated 2 years ago
- ☆57Jan 23, 2024Updated 2 years ago
- Strong and Open Vision Language Assistant for Mobile Devices☆1,372Apr 15, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- 【NeurIPS 2024】Dense Connector for MLLMs☆182Oct 14, 2024Updated 2 years ago
- When do we not need larger vision models?☆419Feb 8, 2025Updated last year
- Official code of *Virgo: A Preliminary Exploration on Reproducing o1-like MLLM*☆110May 27, 2025Updated last year
- A family of lightweight multimodal models.☆1,054Nov 18, 2024Updated 2 years ago
- TinyGPT-V: Efficient Multimodal Large Language Model via Small Backbones☆1,313Feb 5, 2026Updated 9 months ago
- [NeurIPS 2025] Elevating Visual Perception in Multimodal LLMs with Visual Embedding Distillation☆75Oct 17, 2025Updated last year
- Official code implementation of Vary-toy (Small Language Model Meets with Reinforced Vision Vocabulary)☆631Dec 30, 2024Updated last year
- Official Implementation for "MyVLM: Personalizing VLMs for User-Specific Queries" (ECCV 2024)☆190Jul 5, 2024Updated 2 years ago
- [TMLR] Public code repo for paper "A Single Transformer for Scalable Vision-Language Modeling"☆150Nov 14, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- 【TMM 2025🔥】 Mixture-of-Experts for Large Vision-Language Models☆2,320Jul 15, 2025Updated last year
- A Dead Simple and Modularized Multi-Modal Training and Finetune Framework. Compatible to any LLaVA/Flamingo/QwenVL/MiniGemini etc series …☆20Apr 24, 2024Updated 2 years ago
- EVE Series: Encoder-Free Vision-Language Models from BAAI☆377Jul 24, 2025Updated last year
- The code for "TokenPacker: Efficient Visual Projector for Multimodal LLM", IJCV2025☆283May 26, 2025Updated last year
- [CVPR 2024 🔥] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses tha…☆969Sep 5, 2026Updated 2 months ago
- Beyond Hallucinations: Enhancing LVLMs through Hallucination-Aware Direct Preference Optimization☆104Jan 30, 2024Updated 2 years ago
- LLaVA-UHD v3: Progressive Visual Compression for Efficient Native-Resolution Encoding in MLLMs☆427Jul 6, 2026Updated 4 months ago
- This repository provides the code and model checkpoints for AIMv1 and AIMv2 research projects.☆1,425Sep 11, 2026Updated 2 months ago
- mPLUG-HalOwl: Multimodal Hallucination Evaluation and Mitigating☆99Jan 29, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- [NeurIPS 2024] Official implementation of the paper "Interfacing Foundation Models' Embeddings"☆133Aug 21, 2024Updated 2 years ago
- VisionLLaMA: A Unified LLaMA Backbone for Vision Tasks☆391Jul 9, 2024Updated 2 years ago
- MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilities (ICML 2024)☆334Jan 20, 2025Updated last year
- [CVPR'24] RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedback☆311Sep 11, 2024Updated 2 years ago
- Official repository for the paper PLLaVA☆669Jul 28, 2024Updated 2 years ago
- [NeurIPS 2024] MoVA: Adapting Mixture of Vision Experts to Multimodal Context☆174Sep 25, 2024Updated 2 years ago
- Code for paper "Unraveling Cross-Modality Knowledge Conflicts in Large Vision-Language Models."☆55Oct 19, 2024Updated 2 years ago
- ☆35Jan 21, 2025Updated last year
- [ICCV 2025] The official code of the paper "Deciphering Cross-Modal Alignment in Large Vision-Language Models with Modality Integration R…☆114Jul 9, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- [ICLR2025] γ -MOD: Mixture-of-Depth Adaptation for Multimodal Large Language Models☆46Oct 28, 2025Updated last year
- ☆37Sep 16, 2024Updated 2 years ago
- mPLUG-Owl: The Powerful Multi-modal Large Language Model Family☆2,539Apr 2, 2025Updated last year
- ☆70Jan 23, 2026Updated 9 months ago
- ☆364Jan 27, 2024Updated 2 years ago
- This repository, deepspeed-grpo-qlora-vllm, provides a complete framework for fine-tuning LLMs using Group Relative Policy Optimization (…☆13Jul 15, 2025Updated last year
- Emu Series: Generative Multimodal Models from BAAI☆1,777Jan 12, 2026Updated 10 months ago
Are these results useful?