gokayfem / awesome-vlm-architectures
Famous Vision Language Models and Their Architectures
☆565Updated 4 months ago
Alternatives and similar repositories for awesome-vlm-architectures:
Users that are interested in awesome-vlm-architectures are comparing it to the libraries listed below
- A Framework of Small-scale Large Multimodal Models☆709Updated 3 weeks ago
- LLM2CLIP makes SOTA pretrained CLIP model more SOTA ever.☆442Updated this week
- [CVPR 2024 🔥] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses tha…☆814Updated last month
- LLaVA-UHD v2: an MLLM Integrating High-Resolution Feature Pyramid via Hierarchical Window Transformer☆348Updated this week
- Open-source evaluation toolkit of large vision-language models (LVLMs), support 160+ VLMs, 50+ benchmarks☆1,689Updated this week
- A flexible and efficient codebase for training visually-conditioned language models (VLMs)☆543Updated 6 months ago
- [CVPR2024] ViP-LLaVA: Making Large Multimodal Models Understand Arbitrary Visual Prompts☆308Updated 6 months ago
- LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills☆720Updated 11 months ago
- When do we not need larger vision models?☆354Updated last month
- Recent LLM-based CV and related works. Welcome to comment/contribute!☆849Updated 7 months ago
- Quick exploration into fine tuning florence 2☆289Updated 3 months ago
- [ICML2024 (Oral)] Official PyTorch implementation of DoRA: Weight-Decomposed Low-Rank Adaptation☆681Updated 3 months ago
- ☆481Updated 2 months ago
- Repository for Show-o, One Single Transformer to Unify Multimodal Understanding and Generation.☆1,129Updated 3 weeks ago
- [ECCV 2024] official code for "Long-CLIP: Unlocking the Long-Text Capability of CLIP"☆732Updated 5 months ago
- 📖 A curated list of resources dedicated to hallucination of multimodal large language models (MLLM).☆554Updated 3 weeks ago
- VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMs☆1,013Updated last week
- A family of lightweight multimodal models.☆972Updated last month
- Official repository for the paper PLLaVA☆630Updated 5 months ago
- VisionLLM Series☆977Updated 2 weeks ago
- LLaVA-Interactive-Demo☆360Updated 5 months ago
- [ECCV 2024 Oral] Code for paper: An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Langua…☆335Updated last week
- Long Context Transfer from Language to Vision☆356Updated last month
- Anole: An Open, Autoregressive and Native Multimodal Models for Interleaved Image-Text Generation☆708Updated 5 months ago
- 🔥🔥🔥Latest Papers, Codes and Datasets on Vid-LLMs.☆1,820Updated this week
- A minimal codebase for finetuning large multimodal models, supporting llava-1.5/1.6, llava-interleave, llava-next-video, llava-onevision,…☆223Updated 3 weeks ago
- This repository provides the code and model checkpoints for AIMv1 and AIMv2 research projects.☆1,143Updated last month
- 📖 This is a repository for organizing papers, codes and other resources related to unified multimodal models.☆328Updated 3 weeks ago
- A collection of papers on the topic of ``Computer Vision in the Wild (CVinW)''☆1,237Updated 10 months ago
- 🐟 Code and models for the NeurIPS 2023 paper "Generating Images with Multimodal Language Models".☆444Updated 11 months ago