inFaaa / Multimodal-Roadmap-for-freshman

Related projects: ⓘ

• lzhxmu / VTW
  ☆20Updated last month
• PKU-YuanGroup / LLMBind
  LLMBind: A Unified Modality-Task Integration Framework
  ☆14Updated 3 months ago
• wangyuchi369 / LaDiC
  [NAACL 2024] LaDiC: Are Diffusion Models Really Inferior to Autoregressive Counterparts for Image-to-text Generation?
  ☆34Updated 3 months ago
• mrwu-mac / ControlMLLM
  Repo for the paper `ControlMLLM: Training-Free Visual Prompt Learning for Multimodal Large Language Models'
  ☆44Updated 3 weeks ago
• HowardLi1984 / ECDFormer
  The official code for "Deep peak property learning for efficient chiral molecules ECD spectra prediction"
  ☆28Updated 3 months ago
• PKU-YuanGroup / Peer-review-in-LLMs
  Peer-review-in-LLMs: Automatic Evaluation Method for LLMs in Open-environment，https://arxiv.org/pdf/2402.01830.pdf
  ☆26Updated 7 months ago
• SUSTechBruce / LOOK-M
  Official implementation of "LOOK-M: Look-Once Optimization in KV Cache for Efficient Multimodal Long-Context Inference"
  ☆61Updated 2 months ago
• wangclnlp / Vision-LLM-Alignment
  This repo contains the codes for supervised fine-tuning (SFT) and reinforcement learning from human feedback (RLHF) designed for vision L…
  ☆39Updated 3 weeks ago
• longvideobench / LongVideoBench
  Official Dataloader and Evaluation Scripts for LongVideoBench.
  ☆52Updated last month
• bronyayang / HallE_Control
  HallE-Control: Controlling Object Hallucination in LMMs
  ☆24Updated 5 months ago
• VIStA-H / GPT-4V_Social_Media
  GPT-4V(ision) as A Social Media Analysis Engine
  ☆30Updated 10 months ago
• 42Shawn / LLaVA-PruMerge
  LLaVA-PruMerge: Adaptive Token Reduction for Efficient Large Multimodal Models
  ☆86Updated 4 months ago
• PKU-YuanGroup / Video-Bench
  A Comprehensive Benchmark and Toolkit for Evaluating Video-based Large Language Models!
  ☆114Updated 8 months ago
• mutonix / Vript
  ☆113Updated 2 months ago
• Yxxxb / VoCo-LLaMA
  VoCo-LLaMA: This repo is the official implementation of "VoCo-LLaMA: Towards Vision Compression with Large Language Models".
  ☆73Updated 2 months ago
• core-mm / core-mm
  ☆15Updated 6 months ago
• Yuqifan1117 / HalluciDoctor
  HalluciDoctor: Mitigating Hallucinatory Toxicity in Visual Instruction Data (Accepted by CVPR 2024)
  ☆39Updated 2 months ago
• pengts / VW-LMM
  ☆20Updated 4 months ago
• OpenGVLab / MMIU
  MMIU: Multimodal Multi-image Understanding for Evaluating Large Vision-Language Models
  ☆35Updated this week
• BAAI-DCAI / Multimodal-Robustness-Benchmark
  ☆37Updated 3 months ago
• CRIPAC-DIG / LogicCheckGPT
  [ACL 2024] Logical Closed Loop: Uncovering Object Hallucinations in Large Vision-Language Models. Detect and mitigate object hallucinatio…
  ☆16Updated 3 months ago
• Yanqing0327 / MLLMs-Augmented
  The official implementation of 《MLLMs-Augmented Visual-Language Representation Learning》
  ☆31Updated 6 months ago
• AoiDragon / POPE
  [EMNLP'23] The official GitHub page for ''Evaluating Object Hallucination in Large Vision-Language Models''
  ☆67Updated 5 months ago
• MMStar-Benchmark / MMStar
  This repo contains evaluation code for the paper "Are We on the Right Way for Evaluating Large Vision-Language Models"
  ☆138Updated 5 months ago
• ZhengYu518 / VL-Mamba
  Implementation of "VL-Mamba: Exploring State Space Models for Multimodal Learning"
  ☆75Updated 5 months ago
• Go2Heart / EchoSight
  The official PyTorch implementation of EchoSight: Advancing Visual-Language Models with Wiki Knowledge.
  ☆18Updated last month
• yellow-binary-tree / HawkEye
  Official implementation of HawkEye: Training Video-Text LLMs for Grounding Text in Videos
  ☆33Updated 4 months ago
• HJYao00 / DenseConnector
  Dense Connector for MLLMs
  ☆98Updated last month
• AILab-CVC / VL-GPT
  VL-GPT: A Generative Pre-trained Transformer for Vision and Language Understanding and Generation
  ☆84Updated last week
• yihedeng9 / STIC
  Enhancing Large Vision Language Models with Self-Training on Image Comprehension.
  ☆51Updated 3 months ago