lizhaoliu-Lec / CG-VLM
This is the official repo for Contrastive Vision-Language Alignment Makes Efficient Instruction Learner.
☆20Updated last year
Alternatives and similar repositories for CG-VLM:
Users that are interested in CG-VLM are comparing it to the libraries listed below
- Repository of paper: Position-Enhanced Visual Instruction Tuning for Multimodal Large Language Models☆37Updated last year
- ☆89Updated last year
- MMICL, a state-of-the-art VLM with the in context learning ability from ICL, PKU☆46Updated last year
- The official GitHub page for ''What Makes for Good Visual Instructions? Synthesizing Complex Visual Reasoning Instructions for Visual Ins…☆18Updated last year
- Emerging Pixel Grounding in Large Multimodal Models Without Grounding Supervision☆30Updated 4 months ago
- [ICML 2024] Memory-Space Visual Prompting for Efficient Vision-Language Fine-Tuning☆45Updated 9 months ago
- FreeVA: Offline MLLM as Training-Free Video Assistant☆55Updated 8 months ago
- ☆26Updated 6 months ago
- [ICCV2023] Official code for "VL-PET: Vision-and-Language Parameter-Efficient Tuning via Granularity Control"☆53Updated last year
- Official code for "What Makes for Good Visual Tokenizers for Large Language Models?".☆58Updated last year
- Pink: Unveiling the Power of Referential Comprehension for Multi-modal LLMs☆88Updated last month
- Distilling Large Vision-Language Model with Out-of-Distribution Generalizability (ICCV 2023)☆55Updated 10 months ago
- Code Release of F-LMM: Grounding Frozen Large Multimodal Models☆62Updated 6 months ago
- ☆24Updated 9 months ago
- ☆58Updated last year
- Official implementation for CoVLM: Composing Visual Entities and Relationships in Large Language Models Via Communicative Decoding☆44Updated last year
- A collection of visual instruction tuning datasets.☆76Updated 11 months ago
- This is the official repo for ByteVideoLLM/Dynamic-VLM☆19Updated 2 months ago
- Official Codes for Fine-Grained Visual Prompting, NeurIPS 2023☆48Updated last year
- VL-GPT: A Generative Pre-trained Transformer for Vision and Language Understanding and Generation☆85Updated 5 months ago
- VideoEspresso: A Large-Scale Chain-of-Thought Dataset for Fine-Grained Video Reasoning via Core Frame Selection☆51Updated last month
- (ICCV 2023) Betrayed by Captions: Joint Caption Grounding and Generation for Open Vocabulary Instance Segmentation☆46Updated 7 months ago
- VideoNIAH: A Flexible Synthetic Method for Benchmarking Video MLLMs☆37Updated 4 months ago
- MAmmoTH-VL: Eliciting Multimodal Reasoning with Instruction Tuning at Scale☆32Updated 2 months ago
- Evaluation code for Ref-L4, a new REC benchmark in the LMM era☆27Updated last month
- [ICLR2025] Draw-and-Understand: Leveraging Visual Prompts to Enable MLLMs to Comprehend What You Want☆66Updated 3 weeks ago
- VoCoT: Unleashing Visually Grounded Multi-Step Reasoning in Large Multi-Modal Models☆45Updated 7 months ago
- Beyond Hallucinations: Enhancing LVLMs through Hallucination-Aware Direct Preference Optimization☆81Updated last year
- ☆28Updated 11 months ago
- [CVPR' 2024] Contrasting Intra-Modal and Ranking Cross-Modal Hard Negatives to Enhance Visio-Linguistic Fine-grained Understanding☆45Updated 6 months ago