yuecao0119 / MMInstruct

Related projects: ⓘ

• Liuziyu77 / RAR
  The official implementation of RAR
  ☆61Updated 5 months ago
• mrwu-mac / ControlMLLM
  Repo for the paper `ControlMLLM: Training-Free Visual Prompt Learning for Multimodal Large Language Models'
  ☆44Updated 3 weeks ago
• palchenli / VL-Instruction-Tuning
  ☆83Updated 9 months ago
• whwu95 / FreeVA
  FreeVA: Offline MLLM as Training-Free Video Assistant
  ☆42Updated 3 months ago
• Share14 / ShareGemini
  ☆19Updated last month
• YifanXu74 / Libra
  Simple PyTorch implementation of "Libra: Building Decoupled Vision System on Large Language Models" (accepted by ICML 2024)
  ☆41Updated 3 months ago
• foundation-multimodal-models / CAL
  Official PyTorch Implementation of Seeing the Image: Prioritizing Visual Correlation by Contrastive Alignment
  ☆44Updated 3 months ago
• LALBJ / PAI
  [ECCV 2024] Paying More Attention to Image: A Training-Free Method for Alleviating Hallucination in LVLMs
  ☆45Updated last month
• ZhengYu518 / VL-Mamba
  Implementation of "VL-Mamba: Exploring State Space Models for Multimodal Learning"
  ☆75Updated 5 months ago
• PVIT-official / PVIT
  Repository of paper: Position-Enhanced Visual Instruction Tuning for Multimodal Large Language Models
  ☆36Updated last year
• TencentARC / GVT
  Official code for "What Makes for Good Visual Tokenizers for Large Language Models?".
  ☆54Updated last year
• AFeng-x / Draw-and-Understand
  Draw-and-Understand: Leveraging Visual Prompts to Enable MLLMs to Comprehend What You Want
  ☆52Updated 5 months ago
• MengLcool / DeepStack-VL
  ☆31Updated 3 months ago
• chancharikmitra / CCoT
  [CVPR 2024] Official Code for the Paper "Compositional Chain-of-Thought Prompting for Large Multimodal Models"
  ☆57Updated 3 months ago
• ChocoWu / SeTok
  ☆32Updated 3 months ago
• Zi-hao-Wei / Efficient-Vision-Language-Pre-training-by-Cluster-Masking
  [CVPR 2024] Improving language-visual pretraining efficiency by perform cluster-based masking on images.
  ☆20Updated 4 months ago
• deepcs233 / Visual-CoT
  Visual CoT: Advancing Multi-Modal Language Models with a Comprehensive Dataset and Benchmark for Chain-of-Thought Reasoning
  ☆93Updated 2 months ago
• RUCAIBox / ComVint
  The official GitHub page for ''What Makes for Good Visual Instructions? Synthesizing Complex Visual Reasoning Instructions for Visual Ins…
  ☆18Updated 10 months ago
• Lackel / AGLA
  Code for paper "AGLA: Mitigating Object Hallucinations in Large Vision-Language Models with Assembly of Global and Local Attention"
  ☆13Updated 2 months ago
• KangarooGroup / Kangaroo
  official impelmentation of Kangaroo: A Powerful Video-Language Model Supporting Long-context Video Input
  ☆44Updated 3 weeks ago
• Yuqifan1117 / HalluciDoctor
  HalluciDoctor: Mitigating Hallucinatory Toxicity in Visual Instruction Data (Accepted by CVPR 2024)
  ☆39Updated 2 months ago
• lizhaoliu-Lec / CG-VLM
  This is the official repo for Contrastive Vision-Language Alignment Makes Efficient Instruction Learner.
  ☆21Updated 9 months ago
• HenryHZY / VL-PET
  [ICCV2023] Official code for "VL-PET: Vision-and-Language Parameter-Efficient Tuning via Granularity Control"
  ☆51Updated 11 months ago
• kodenii / Ref-Diff
  ☆16Updated last year
• yfzhang114 / LLaVA-Align
  This is the official repo for Debiasing Large Visual Language Models, including a Post-Hoc debias method and Visual Debias Decoding strat…
  ☆66Updated 5 months ago
• core-mm / core-mm
  ☆15Updated 6 months ago
• Becomebright / GroundVQA
  Official PyTorch code of "Grounded Question-Answering in Long Egocentric Videos", accepted by CVPR 2024.
  ☆49Updated last week
• JieShibo / MemVP
  [ICML 2024] Memory-Space Visual Prompting for Efficient Vision-Language Fine-Tuning
  ☆41Updated 4 months ago
• BAAI-DCAI / DataOptim
  A collection of visual instruction tuning datasets.
  ☆74Updated 6 months ago
• OpenGVLab / LCL
  Vision Model Pre-training on Interleaved Image-Text Data via Latent Compression Learning
  ☆58Updated 3 months ago