ByungKwanLee / MoAI
[ECCV 2024] Official PyTorch implementation code for realizing the technical part of Mixture of All Intelligence (MoAI) to improve performance of numerous zero-shot vision language tasks.
☆310Updated 7 months ago
Related projects ⓘ
Alternatives and complementary repositories for MoAI
- [EMNLP 2024] Official PyTorch implementation code for realizing the technical part of Traversal of Layers (TroL) presenting new propagati…☆88Updated 4 months ago
- [ACL 2024 Findings] Official PyTorch Implementation code for realizing the technical part of CoLLaVO: Crayon Large Language and Vision mO…☆93Updated 4 months ago
- [NeurIPS 2024] Official PyTorch implementation code for realizing the technical part of Mamba-based traversal of rationale (Meteor) to im…☆102Updated 5 months ago
- LLaVA-HR: High-Resolution Large Language-Vision Assistant☆212Updated 3 months ago
- E5-V: Universal Embeddings with Multimodal Large Language Models☆173Updated 4 months ago
- LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills☆708Updated 9 months ago
- LLaVA-UHD: an LMM Perceiving Any Aspect Ratio and High-Resolution Images☆318Updated last month
- MoRA: High-Rank Updating for Parameter-Efficient Fine-Tuning☆340Updated 3 months ago
- [CVPR2024] ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Prompts☆297Updated 4 months ago
- An open-source implementaion for fine-tuning Phi3-Vision and Phi3.5-Vision by Microsoft.☆72Updated 2 weeks ago
- LLM2CLIP makes SOTA pretrained CLIP model more SOTA ever.☆242Updated this week
- The official repo for the paper "VeCLIP: Improving CLIP Training via Visual-enriched Captions"☆228Updated 2 months ago
- a family of highly capabale yet efficient large multimodal models☆166Updated 2 months ago
- Official implementation of project Honeybee (CVPR 2024)☆432Updated 6 months ago
- When do we not need larger vision models?☆336Updated this week
- ☆146Updated last month
- LLaVA-Interactive-Demo☆352Updated 3 months ago
- LongLLaVA: Scaling Multi-modal LLMs to 1000 Images Efficiently via Hybrid Architecture☆179Updated last month
- Python Library to evaluate VLM models' robustness across diverse benchmarks☆169Updated 3 weeks ago
- PyTorch Implementation of "V* : Guided Visual Search as a Core Mechanism in Multimodal LLMs"☆527Updated 10 months ago
- Official Repository of paper VideoGPT+: Integrating Image and Video Encoders for Enhanced Video Understanding☆217Updated 3 months ago
- HPT - Open Multimodal LLMs from HyperGAI☆312Updated 5 months ago
- Code/Data for the paper: "LLaVAR: Enhanced Visual Instruction Tuning for Text-Rich Image Understanding"☆258Updated 5 months ago
- [ECCV 2024 Oral] Code for paper: An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Langua…☆274Updated 3 months ago
- EAGLE: Exploring The Design Space for Multimodal LLMs with Mixture of Encoders☆539Updated 2 months ago
- Cobra: Extending Mamba to Multi-modal Large Language Model for Efficient Inference☆257Updated 3 months ago
- This is the official repository of our paper "What If We Recaption Billions of Web Images with LLaMA-3 ?"☆121Updated 5 months ago
- VCoder: Versatile Vision Encoders for Multimodal Large Language Models, arXiv 2023 / CVPR 2024☆261Updated 7 months ago
- CuMo: Scaling Multimodal LLM with Co-Upcycled Mixture-of-Experts☆134Updated 5 months ago
- Implementation of PALI3 from the paper PALI-3 VISION LANGUAGE MODELS: SMALLER, FASTER, STRONGER"☆142Updated last week