X-PLUG / mPLUG-DocOwl

Related projects ⓘ

Alternatives and complementary repositories for mPLUG-DocOwl

• THUDM / CogVLM2
  GPT4V-level open-source multi-modal model based on Llama3-8B
  ☆2,122Updated 2 months ago
• QwenLM / Qwen2-VL
  Qwen2-VL is the multimodal large language model series developed by Qwen team, Alibaba Cloud.
  ☆3,153Updated last month
• AlibabaResearch / AdvancedLiterateMachinery
  A collection of original, innovative ideas and algorithms towards Advanced Literate Machinery. This project is maintained by the OCR Team…
  ☆1,501Updated last month
• OpenBMB / VisRAG
  Parsing-free RAG supported by VLMs
  ☆388Updated this week
• LLaVA-VL / LLaVA-NeXT
  ☆2,898Updated last month
• InternLM / InternLM-XComposer
  InternLM-XComposer-2.5: A Versatile Large Vision Language Model Supporting Long-Contextual Input and Output
  ☆2,525Updated last month
• open-compass / VLMEvalKit
  Open-source evaluation toolkit of large vision-language models (LVLMs), support 160+ VLMs, 50+ benchmarks
  ☆1,361Updated this week
• RUC-NLPIR / FlashRAG
  ⚡FlashRAG: A Python Toolkit for Efficient RAG Research
  ☆1,335Updated this week
• PKU-YuanGroup / MoE-LLaVA
  Mixture-of-Experts for Large Vision-Language Models
  ☆1,989Updated 6 months ago
• AIDC-AI / Ovis
  A novel Multimodal Large Language Model (MLLM) architecture, designed to structurally align visual and textual embeddings.
  ☆526Updated 2 weeks ago
• InternLM / lagent
  A lightweight framework for building LLM-based agents
  ☆1,868Updated this week
• opendatalab / DocLayout-YOLO
  DocLayout-YOLO: Enhancing Document Layout Analysis through Diverse Synthetic Data and Global-to-Local Adaptive Perception
  ☆497Updated 3 weeks ago
• multimodal-art-projection / MAP-NEO
  ☆878Updated 5 months ago
• Yuliang-Liu / MultimodalOCR
  On the Hidden Mystery of OCR in Large Multimodal Models (OCRBench)
  ☆473Updated last month
• OSU-NLP-Group / HippoRAG
  [NeurIPS'24] HippoRAG is a novel RAG framework inspired by human long-term memory that enables LLMs to continuously integrate knowledge a…
  ☆1,378Updated 3 months ago
• qhjqhj00 / MemoRAG
  Empowering RAG with a memory-based data interface for all-purpose applications!
  ☆1,220Updated last week
• deepseek-ai / Janus
  Janus-Series: Unified Multimodal Understanding and Generation Models
  ☆1,084Updated last week
• BatsResearch / bonito
  A lightweight library for generating synthetic instruction tuning datasets for your data without GPT.
  ☆700Updated 2 months ago
• PKU-YuanGroup / LLaVA-o1
  ☆763Updated this week
• QwenLM / Qwen-VL
  The official repo of Qwen-VL (通义千问-VL) chat & pretrained large vision language model proposed by Alibaba Cloud.
  ☆5,055Updated 3 months ago
• AkariAsai / self-rag
  This includes the original implementation of SELF-RAG: Learning to Retrieve, Generate and Critique through self-reflection by Akari Asai,…
  ☆1,836Updated 5 months ago
• gusye1234 / nano-graphrag
  A simple, easy-to-hack GraphRAG implementation
  ☆1,534Updated this week
• deepseek-ai / DeepSeek-VL
  DeepSeek-VL: Towards Real-World Vision-Language Understanding
  ☆2,077Updated 6 months ago
• illuin-tech / colpali
  The code used to train and run inference with the ColPali architecture.
  ☆1,132Updated this week
• BAAI-DCAI / Bunny
  A family of lightweight multimodal models.
  ☆933Updated this week
• TinyLLaVA / TinyLLaVA_Factory
  A Framework of Small-scale Large Multimodal Models
  ☆652Updated last month
• amazon-science / RAGChecker
  RAGChecker: A Fine-grained Framework For Diagnosing RAG
  ☆542Updated last month
• InternLM / xtuner
  An efficient, flexible and full-featured toolkit for fine-tuning LLM (InternLM2, Llama3, Phi3, Qwen, Mistral, ...)
  ☆3,977Updated last week
• mbzuai-oryx / LLaVA-pp
  🔥🔥 LLaVA++: Extending LLaVA with Phi-3 and LLaMA-3 (LLaVA LLaMA-3, LLaVA Phi-3)
  ☆813Updated 4 months ago
• Ucas-HaoranWei / Vary
  [ECCV 2024] Official code implementation of Vary: Scaling Up the Vision Vocabulary of Large Vision Language Models.
  ☆1,819Updated last month