Alternatives and similar repositories for SciMMIR:

Users that are interested in SciMMIR are comparing it to the libraries listed below

• OpenMatch / MARVEL
  [ACL 2024] This is the code repo for our ACL‘24 paper "MARVEL: Unlocking the Multi-Modal Capability of Dense Retrieval via Visual Module …
  ☆35Updated 9 months ago
• tianyang-x / Mixture-of-Domain-Adapters
  Codebase for ACL 2023 paper "Mixture-of-Domain-Adapters: Decoupling and Injecting Domain Knowledge to Pre-trained Language Models' Memori…
  ☆47Updated last year
• iwangjian / Midi-Tuning
  Instruct Once, Chat Consistently in Multiple Rounds: An Efficient Tuning Framework for Dialogue (ACL 2024)
  ☆23Updated 8 months ago
• gyhdog99 / MoCLE
  MoCLE (First MLLM with MoE for instruction customization and generalization!) (https://arxiv.org/abs/2312.12379)
  ☆35Updated last year
• HITsz-TMG / SKURG
  ☆18Updated last year
• luka-group / mDPO
  [EMNLP 2024] mDPO: Conditional Preference Optimization for Multimodal Large Language Models.
  ☆72Updated 5 months ago
• haon-chen / mmE5
  ☆46Updated last month
• Nardien / KARD
  Official Code Repository for the paper "Knowledge-Augmented Reasoning Distillation for Small Language Models in Knowledge-intensive Tasks…
  ☆37Updated 5 months ago
• open-vision-language / oven
  ☆35Updated last year
• TIGER-AI-Lab / UniIR
  Official code for paper "UniIR: Training and Benchmarking Universal Multimodal Information Retrievers" (ECCV 2024)
  ☆139Updated 6 months ago
• RUCAIBox / JiuZhang3.0
  The code and data for the paper JiuZhang3.0
  ☆43Updated 10 months ago
• princeton-nlp / PTP
  Improving Language Understanding from Screenshots. Paper: https://arxiv.org/abs/2402.14073
  ☆28Updated 9 months ago
• IDEA-FinAI / RagVL
  Official PyTorch Implementation of MLLM Is a Strong Reranker: Advancing Multimodal Retrieval-augmented Generation via Knowledge-enhanced …
  ☆66Updated 5 months ago
• SihengLi99 / LLM-Honesty-Survey
  A Survey on the Honesty of Large Language Models
  ☆57Updated 4 months ago
• xinghaow99 / DenoSent
  [AAAI 2024] DenoSent: A Denoising Objective for Self-Supervised Sentence Representation Learning
  ☆16Updated 11 months ago
• luomancs / ReMuQ
  a multimodal retrieval dataset
  ☆22Updated last year
• lfy79001 / Awesome-Table-QA
  A comprehensive paper list of Table-based Question Answering.
  ☆27Updated last year
• JiwanChung / vlis
  ☆24Updated last year
• YuxiXie / V-DPO
  Preference Learning for LLaVA
  ☆43Updated 5 months ago
• LightChen233 / M3CoT
  ☆72Updated 10 months ago
• OpenGVLab / ChartAst
  [ACL 2024] ChartAssistant is a chart-based vision-language model for universal chart comprehension and reasoning.
  ☆115Updated 7 months ago
• ZhangYiqun018 / StickerConv
  ☆45Updated 10 months ago
• OpenMOSS / Say-I-Dont-Know
  [ICML'2024] Can AI Assistants Know What They Don't Know?
  ☆79Updated last year
• edchengg / infoseek_eval
  EMNLP2023 - InfoSeek: A New VQA Benchmark focus on Visual Info-Seeking Questions
  ☆22Updated 10 months ago
• SihengLi99 / TextBind
  [2024-ACL]: TextBind: Multi-turn Interleaved Multimodal Instruction-following in the Wildrounded Conversation
  ☆47Updated last year
• albertwy / GPT-4V-Evaluation
  Data for evaluating GPT-4V
  ☆11Updated last year
• lfy79001 / S3Eval
  [NAACL 2024] A Synthetic, Scalable and Systematic Evaluation Suite for Large Language Models
  ☆32Updated 10 months ago
• RainBowLuoCS / DEEM
  (ICLR2025 Spotlight) DEEM: Official implementation of Diffusion models serve as the eyes of large language models for image perception.
  ☆29Updated last month
• edchengg / oven_eval
  ICCV 2023 (Oral) Open-domain Visual Entity Recognition Towards Recognizing Millions of Wikipedia Entities
  ☆40Updated 7 months ago
• BenfengXu / KNNPrompting
  Released code for our ICLR23 paper.
  ☆64Updated 2 years ago