gokayfem / awesome-vlm-architectures
Famous Vision Language Models and Their Architectures
☆622Updated this week
Alternatives and similar repositories for awesome-vlm-architectures:
Users that are interested in awesome-vlm-architectures are comparing it to the libraries listed below
- Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks☆1,819Updated this week
- [CVPR 2024 🔥] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses tha…☆823Updated 2 months ago
- [ECCV 2024] official code for "Long-CLIP: Unlocking the Long-Text Capability of CLIP"☆746Updated 6 months ago
- A family of lightweight multimodal models.☆986Updated 2 months ago
- LLM2CLIP makes SOTA pretrained CLIP model more SOTA ever.☆465Updated 3 weeks ago
- A Framework of Small-scale Large Multimodal Models☆740Updated 2 weeks ago
- Anole: An Open, Autoregressive and Native Multimodal Models for Interleaved Image-Text Generation☆718Updated 6 months ago
- LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills☆722Updated last year
- When do we not need larger vision models?☆364Updated last week
- 📖 This is a repository for organizing papers, codes and other resources related to unified multimodal models.☆364Updated 3 weeks ago
- PyTorch Implementation of "V* : Guided Visual Search as a Core Mechanism in Multimodal LLMs"☆565Updated last year
- 📖 A curated list of resources dedicated to hallucination of multimodal large language models (MLLM).☆578Updated last month
- VisionLLM Series☆996Updated last week
- A minimal codebase for finetuning large multimodal models, supporting llava-1.5/1.6, llava-interleave, llava-next-video, llava-onevision,…☆244Updated 2 weeks ago
- LLaVA-UHD v2: an MLLM Integrating High-Resolution Feature Pyramid via Hierarchical Window Transformer☆364Updated last month
- A flexible and efficient codebase for training visually-conditioned language models (VLMs)☆568Updated 7 months ago
- Autoregressive Model Beats Diffusion: 🦙 Llama for Scalable Image Generation☆1,561Updated 6 months ago
- Recent LLM-based CV and related works. Welcome to comment/contribute!☆851Updated 8 months ago
- The official GitHub page for the review paper "Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision M…☆495Updated 10 months ago
- [ICML2024 (Oral)] Official PyTorch implementation of DoRA: Weight-Decomposed Low-Rank Adaptation☆710Updated 4 months ago
- Paper list about multimodal and large language models, only used to record papers I read in the daily arxiv for personal needs.☆585Updated this week
- Next-Token Prediction is All You Need☆1,992Updated 3 months ago
- Quick exploration into fine tuning florence 2☆294Updated 4 months ago
- [ECCV 2024 Oral] Code for paper: An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Langua…☆356Updated last month
- Official repository for the paper PLLaVA☆637Updated 6 months ago
- [ICLR 2025] Repository for Show-o, One Single Transformer to Unify Multimodal Understanding and Generation.☆1,197Updated this week
- [CVPR2024] ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Prompts☆310Updated 6 months ago
- LLaVA-Interactive-Demo☆362Updated 6 months ago
- Compose multimodal datasets 🎹☆279Updated last week