Alternatives and similar repositories for MultiModal_BigModels_Survey

Users that are interested in MultiModal_BigModels_Survey are comparing it to the libraries listed below

• Yutong-Zhou-cv / Awesome-Multimodality
  A Survey on multimodal learning research.
  ☆334Updated 2 years ago
• phellonchen / awesome-Vision-and-Language-Pre-training
  Recent Advances in Vision and Language Pre-training (VLP)
  ☆297Updated 2 years ago
• wanng-ide / VQA_to_multimodal_survey
  Update 2020
  ☆75Updated 3 years ago
• uta-smile / TCL
  code for TCL: Vision-Language Pre-Training with Triple Contrastive Learning, CVPR 2022
  ☆268Updated last year
• Atomic-man007 / Awesome_Multimodel_LLM
  Awesome_Multimodel is a curated GitHub repository that provides a comprehensive collection of resources for Multimodal Large Language Mod…
  ☆357Updated 9 months ago
• LinWeizheDragon / Retrieval-Augmented-Visual-Question-Answering
  This is the official repository for Retrieval Augmented Visual Question Answering
  ☆245Updated last year
• zengyan-97 / X2-VLM
  All-In-One VLM: Image + Video + Transfer to Other Languages / Domains (TPAMI 2023)
  ☆166Updated last year
• jianghaojun / Awesome-Parameter-Efficient-Transfer-Learning
  A collection of parameter-efficient transfer learning papers focusing on computer vision and multimodal domains.
  ☆410Updated last year
• zengyan-97 / X-VLM
  X-VLM: Multi-Grained Vision Language Pre-Training (ICML 2022)
  ☆488Updated 3 years ago
• HaozheZhao / MIC
  MMICL, a state-of-the-art VLM with the in context learning ability from ICL, PKU
  ☆358Updated 2 years ago
• jxhe / unify-parameter-efficient-tuning
  Implementation of paper "Towards a Unified View of Parameter-Efficient Transfer Learning" (ICLR 2022)
  ☆540Updated 3 years ago
• FuxiaoLiu / LRV-Instruction
  [ICLR'24] Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction Tuning
  ☆294Updated last year
• zjukg / Structure-CLIP
  [Paper][AAAI2024]Structure-CLIP: Towards Scene Graph Knowledge to Enhance Multi-modal Structured Representations
  ☆152Updated last year
• OpenGVLab / LAMM
  [NeurIPS 2023 Datasets and Benchmarks Track] LAMM: Multi-Modal Large Language Models and Applications as AI Agents
  ☆317Updated last year
• JiuTian-VL / JiuTian-LION
  [CVPR 2024] LION: Empowering Multimodal Large Language Model with Dual-Level Visual Knowledge
  ☆153Updated 4 months ago
• HenryHZY / Awesome-Multimodal-LLM
  Research Trends in LLM-guided Multimodal Learning.
  ☆357Updated 2 years ago
• LijieFan / LaCLIP
  [NeurIPS 2023] Text data, code and pre-trained models for paper "Improving CLIP Training with Language Rewrites"
  ☆287Updated 2 years ago
• dongguanting / In-Context-Learning_PaperList
  Paper List for In-context Learning 🌷
  ☆188Updated last year
• OpenGVLab / Multi-Modality-Arena
  Chatbot Arena meets multi-modality! Multi-Modality Arena allows you to benchmark vision-language models side-by-side while providing imag…
  ☆555Updated last year
• ylsung / Ladder-Side-Tuning
  PyTorch codes for "LST: Ladder Side-Tuning for Parameter and Memory Efficient Transfer Learning"
  ☆242Updated 2 years ago
• AILab-CVC / SEED-Bench
  (CVPR2024)A benchmark for evaluating Multimodal LLMs using multiple-choice questions.
  ☆358Updated last year
• swordlidev / Efficient-Multimodal-LLMs-Survey
  Efficient Multimodal Large Language Models: A Survey
  ☆383Updated 8 months ago
• tsb0601 / MMVP
  ☆356Updated last year
• MILVLG / prophet
  Implementation of CVPR 2023 paper "Prompting Large Language Models with Answer Heuristics for Knowledge-based Visual Question Answering".
  ☆277Updated 7 months ago
• sunanhe / MKT
  Official implementation of "Open-Vocabulary Multi-Label Classification via Multi-Modal Knowledge Transfer".
  ☆130Updated last year
• luogen1996 / LaVIN
  [NeurIPS 2023] Official implementations of "Cheap and Quick: Efficient Vision-Language Instruction Tuning for Large Language Models"
  ☆525Updated last year
• ziqipang / LM4VisualEncoding
  [ICLR 2024 (Spotlight)] "Frozen Transformers in Language Models are Effective Visual Encoder Layers"
  ☆247Updated 2 years ago
• X-PLUG / mPLUG
  mPLUG: Effective and Efficient Vision-Language Learning by Cross-modal Skip-connections. (EMNLP 2022)
  ☆97Updated 2 years ago
• RUCAIBox / POPE
  The official GitHub page for ''Evaluating Object Hallucination in Large Vision-Language Models''
  ☆242Updated 4 months ago
• amazon-science / mix-generation
  MixGen: A New Multi-Modal Data Augmentation
  ☆126Updated 3 years ago