2U1 / Qwen2-VL-Finetune

Related projects: ⓘ

• LayTextLLM / LayTextLLM
  ☆54Updated 3 weeks ago
• zhangfaen / finetune-Qwen2-VL
  ☆79Updated this week
• yuyq96 / TextHawk
  Exploring Efficient Fine-Grained Perception of Multimodal Large Language Models
  ☆45Updated 4 months ago
• 360CVGroup / 360VL
  ☆29Updated 3 months ago
• MonolithFoundation / Bumblebee
  A Simple MLLM Surpassed QwenVL-Max with OpenSource Data Only in 14B LLM.
  ☆35Updated last week
• large-ocr-model / large-ocr-model.github.io
  ☆146Updated 6 months ago
• LinWeizheDragon / FLMR
  The huggingface implementation of Fine-grained Late-interaction Multi-modal Retriever.
  ☆64Updated 2 weeks ago
• SCUT-DLVCLab / GPT-4V_OCR
  Evaluation of the Optical Character Recognition (OCR) capabilities of GPT-4V(ision)
  ☆116Updated 10 months ago
• Veason-silverbullet / ViTLP
  [NAACL 2024] Visually Guided Generative Text-Layout Pre-training for Document Intelligence
  ☆41Updated last week
• ucaslcl / Fox
  official code for "Fox: Focus Anywhere for Fine-grained Multi-page Document Understanding"
  ☆102Updated 3 months ago
• Ucas-HaoranWei / Vary-tiny-600k
  Vary-tiny codebase upon LAVIS （for training from scratch）and a PDF image-text pairs data (about 600k including English/Chinese)
  ☆43Updated 4 months ago
• zjysteven / lmms-finetune
  A minimal codebase for finetuning large multimodal models, supporting llava-1.5/1.6, llava-interleave, llava-next-video, qwen-vl, phi3-v …
  ☆123Updated last week
• FudanNLPLAB / MouSi
  ☆70Updated 6 months ago
• harrytea / Awesome-Document-Understanding
  Document Artifical Intelligence
  ☆113Updated last week
• deepglint / RWKV-CLIP
  The official code of "RWKV-CLIP: A Robust Vision-Language Representation Learner"
  ☆97Updated 2 months ago
• mayubo2333 / MMLongBench-Doc
  Official Repository of MMLONGBENCH-DOC: Benchmarking Long-context Document Understanding with Visualizations
  ☆47Updated 2 months ago
• Ucas-HaoranWei / Vary-family
  ☆53Updated 7 months ago
• nttmdlab-nlp / InstructDoc
  InstructDoc: A Dataset for Zero-Shot Generalization of Visual Document Understanding with Instructions (AAAI2024)
  ☆134Updated 3 months ago
• kyegomez / Kosmos2.5
  My implementation of Kosmos2.5 from the paper: "KOSMOS-2.5: A Multimodal Literate Model"
  ☆68Updated last week
• LukeForeverYoung / UReader
  ☆110Updated 7 months ago
• SpursGoZmy / Table-LLaVA
  Dataset and Code for our ACL 2024 paper: "Multimodal Table Understanding". We propose the first large-scale Multimodal IFT and Pre-Train …
  ☆132Updated last month
• OpenGVLab / MM-NIAH
  This is the official implementation of the paper "Needle In A Multimodal Haystack"
  ☆72Updated 2 months ago
• Yuliang-Liu / VimTS
  VimTS: A Unified Video and Image Text Spotter
  ☆72Updated 3 months ago
• poloclub / tsr-convstem
  High-Performance Transformers for Table Structure Recognition Need Early Convolutions
  ☆38Updated 5 months ago
• bytedance / MTVQA
  MTVQA: Benchmarking Multilingual Text-Centric Visual Question Answering. A comprehensive evaluation of multimodal large model multilingua…
  ☆33Updated last week
• GbotHQ / ocr-dataset-rendering
  ☆15Updated 11 months ago
• MILVLG / imp
  a family of highly capabale yet efficient large multimodal models
  ☆155Updated 3 weeks ago
• ppaanngggg / layoutreader
  A Faster LayoutReader Model based on LayoutLMv3, Sort OCR bboxes to reading order.
  ☆76Updated 3 months ago
• OpenGVLab / OmniCorpus
  OmniCorpus: A Unified Multimodal Corpus of 10 Billion-Level Images Interleaved with Text
  ☆246Updated 3 weeks ago
• kyegomez / PALI3
  Implementation of PALI3 from the paper PALI-3 VISION LANGUAGE MODELS: SMALLER, FASTER, STRONGER"
  ☆138Updated last week