ziqipang / LM4VisualEncodingLinks
[ICLR 2024 (Spotlight)] "Frozen Transformers in Language Models are Effective Visual Encoder Layers"
☆244Updated last year
Alternatives and similar repositories for LM4VisualEncoding
Users that are interested in LM4VisualEncoding are comparing it to the libraries listed below
Sorting:
- ☆356Updated last year
- [COLM'25] Official implementation of the Law of Vision Representation in MLLMs☆168Updated 2 weeks ago
- LLaVA-PruMerge: Adaptive Token Reduction for Efficient Large Multimodal Models☆150Updated 3 weeks ago
- [CVPR 2024] Prompt Highlighter: Interactive Control for Multi-Modal LLMs☆154Updated last year
- Official implementation of "Why are Visually-Grounded Language Models Bad at Image Classification?" (NeurIPS 2024)☆91Updated last year
- MLLM-Tool: A Multimodal Large Language Model For Tool Agent Learning☆134Updated 2 weeks ago
- [TMLR] Public code repo for paper "A Single Transformer for Scalable Vision-Language Modeling"☆148Updated 11 months ago
- [NeurIPS 2023 Datasets and Benchmarks Track] LAMM: Multi-Modal Large Language Models and Applications as AI Agents☆316Updated last year
- ☆99Updated last year
- EVE Series: Encoder-Free Vision-Language Models from BAAI☆353Updated 3 months ago
- [TPAMI] Searching prompt modules for parameter-efficient transfer learning.☆235Updated last year
- official implementation of "Interpreting CLIP's Image Representation via Text-Based Decomposition"☆232Updated 4 months ago
- [NeurIPS 2023] Text data, code and pre-trained models for paper "Improving CLIP Training with Language Rewrites"☆286Updated last year
- ☆119Updated last year
- Densely Captioned Images (DCI) dataset repository.☆191Updated last year
- [CVPR'2025] VoCo-LLaMA: This repo is the official implementation of "VoCo-LLaMA: Towards Vision Compression with Large Language Models".☆191Updated 4 months ago
- A Comprehensive Benchmark and Toolkit for Evaluating Video-based Large Language Models!☆133Updated last year
- [NeurIPS 2024] Visual Perception by Large Language Model’s Weights☆52Updated 6 months ago
- SVIT: Scaling up Visual Instruction Tuning☆163Updated last year
- Code for DeCo: Decoupling token compression from semanchc abstraction in multimodal large language models☆73Updated 3 months ago
- [NeurIPS 2024] Efficient Large Multi-modal Models via Visual Context Compression☆61Updated 8 months ago
- [NeurIPS 2024] Classification Done Right for Vision-Language Pre-Training☆217Updated 7 months ago
- code for "Strengthening Multimodal Large Language Model with Bootstrapped Preference Optimization"☆59Updated last year
- A collection of visual instruction tuning datasets.☆76Updated last year
- LLaVA-NeXT-Image-Llama3-Lora, Modified from https://github.com/arielnlee/LLaVA-1.6-ft☆44Updated last year
- [ICLR'25] Reconstructive Visual Instruction Tuning☆121Updated 6 months ago
- ☆137Updated last year
- 【NeurIPS 2024】Dense Connector for MLLMs☆179Updated last year
- [NeurIPS'24] Official PyTorch Implementation of Seeing the Image: Prioritizing Visual Correlation by Contrastive Alignment☆57Updated last year
- [ACM Multimedia 2025] This is the official repo for Debiasing Large Visual Language Models, including a Post-Hoc debias method and Visual…☆82Updated 8 months ago