Alternatives and similar repositories for SciMMIR

Users that are interested in SciMMIR are comparing it to the libraries listed below

• OpenMatch / MARVEL
  [ACL 2024] This is the code repo for our ACL‘24 paper "MARVEL: Unlocking the Multi-Modal Capability of Dense Retrieval via Visual Module …
  ☆36Updated last year
• tianyang-x / Mixture-of-Domain-Adapters
  Codebase for ACL 2023 paper "Mixture-of-Domain-Adapters: Decoupling and Injecting Domain Knowledge to Pre-trained Language Models' Memori…
  ☆49Updated last year
• HITsz-TMG / SKURG
  ☆17Updated last year
• PLUM-Lab / MultiInstruct
  MultiInstruct: Improving Multi-Modal Zero-Shot Learning via Instruction Tuning
  ☆135Updated 2 years ago
• TIGER-AI-Lab / UniIR
  Official code for paper "UniIR: Training and Benchmarking Universal Multimodal Information Retrievers" (ECCV 2024)
  ☆161Updated 10 months ago
• open-vision-language / oven
  ☆40Updated 2 years ago
• BenfengXu / KNNPrompting
  Released code for our ICLR23 paper.
  ☆65Updated 2 years ago
• Aman-4-Real / awesome-multimodal-dialogue
  Paper, dataset and code list for multimodal dialogue.
  ☆21Updated 7 months ago
• gyhdog99 / MoCLE
  MoCLE (First MLLM with MoE for instruction customization and generalization!) (https://arxiv.org/abs/2312.12379)
  ☆43Updated last month
• JiwanChung / vlis
  ☆24Updated last year
• FuxiaoLiu / MMC
  [NAACL 2024] MMC: Advancing Multimodal Chart Understanding with LLM Instruction Tuning
  ☆98Updated 7 months ago
• iwangjian / Midi-Tuning
  Instruct Once, Chat Consistently in Multiple Rounds: An Efficient Tuning Framework for Dialogue (ACL 2024)
  ☆23Updated last year
• kongds / scaling_sentemb
  Scaling Sentence Embeddings with Large Language Models
  ☆111Updated last year
• marslanm / Multimodality-Representation-Learning
  This repository provides a comprehensive collection of research papers focused on multimodal representation learning, all of which have b…
  ☆77Updated 2 months ago
• HZQ950419 / Math-LLaVA
  Code for Math-LLaVA: Bootstrapping Mathematical Reasoning for Multimodal Large Language Models
  ☆90Updated last year
• haon-chen / mmE5
  ☆49Updated 6 months ago
• luka-group / mDPO
  [EMNLP 2024] mDPO: Conditional Preference Optimization for Multimodal Large Language Models.
  ☆79Updated 9 months ago
• FreedomIntelligence / MLLM-Bench
  MLLM-Bench: Evaluating Multimodal LLMs with Per-sample Criteria
  ☆70Updated 10 months ago
• nttmdlab-nlp / SlideVQA
  SlideVQA: A Dataset for Document Visual Question Answering on Multiple Images (AAAI2023)
  ☆92Updated 4 months ago
• NExTplusplus / TAT-DQA
  TAT-DQA: Towards Complex Document Understanding By Discrete Reasoning
  ☆23Updated 11 months ago
• JetRunner / SuperICL
  Code for "Small Models are Valuable Plug-ins for Large Language Models"
  ☆131Updated 2 years ago
• PaulLerner / ViQuAE
  Source code and data used in the papers ViQuAE (Lerner et al., SIGIR'22), Multimodal ICT (Lerner et al., ECIR'23) and Cross-modal Retriev…
  ☆38Updated 8 months ago
• HYPJUDY / Sparkles
  Sparkles: Unlocking Chats Across Multiple Images for Multimodal Instruction-Following Models
  ☆44Updated last year
• WebQnA / WebQA
  ☆55Updated 7 months ago
• SihengLi99 / TextBind
  [2024-ACL]: TextBind: Multi-turn Interleaved Multimodal Instruction-following in the Wildrounded Conversation
  ☆47Updated last year
• X-PLUG / mPLUG
  mPLUG: Effective and Efficient Vision-Language Learning by Cross-modal Skip-connections. (EMNLP 2022)
  ☆96Updated 2 years ago
• vis-nlp / UniChart
  ☆80Updated last year
• open-vision-language / infoseek
  ☆60Updated last year
• Yuco-Z / Awesome-Multi-Modal-Dialog
  [Paperlist] Awesome paper list of multimodal dialog, including methods, datasets and metrics
  ☆38Updated 7 months ago
• ECNU-ICALK / EduChat-Math
  ☆39Updated 10 months ago