Alternatives and similar repositories for UNIT:

Users that are interested in UNIT are comparing it to the libraries listed below

• MengLcool / DeepStack-VL
  [NeurIPS-24] This is the official implementation of the paper "DeepStack: Deeply Stacking Visual Tokens is Surprisingly Simple and Effect…
  ☆35Updated 10 months ago
• baaivision / DenseFusion
  DenseFusion-1M: Merging Vision Experts for Comprehensive Multimodal Perception
  ☆143Updated 5 months ago
• TencentARC / GVT
  Official code for "What Makes for Good Visual Tokenizers for Large Language Models?".
  ☆58Updated last year
• mightyzau / InfMLLM
  ☆19Updated last year
• X2FD / LVIS-INSTRUCT4V
  ☆133Updated last year
• opendatalab / MLLM-DataEngine
  MLLM-DataEngine: An Iterative Refinement Approach for MLLM
  ☆46Updated 11 months ago
• alibaba / conv-llava
  ☆115Updated 9 months ago
• OpenGVLab / MMIU
  [ICLR2025] MMIU: Multimodal Multi-image Understanding for Evaluating Large Vision-Language Models
  ☆69Updated 7 months ago
• yuecao0119 / MMInstruct
  [SCIS 2024] The official implementation of the paper "MMInstruct: A High-Quality Multi-Modal Instruction Tuning Dataset with Extensive Di…
  ☆49Updated 5 months ago
• SliMM-X / CoMP-MM
  Official repository of "CoMP: Continual Multimodal Pre-training for Vision Foundation Models"
  ☆24Updated last month
• TencentARC / SEED-Bench-R1
  ☆80Updated last month
• mu-cai / matryoshka-mm
  Matryoshka Multimodal Models
  ☆101Updated 3 months ago
• Hon-Wong / ByteVideoLLM
  This is the official repo for ByteVideoLLM/Dynamic-VLM
  ☆20Updated 4 months ago
• OpenGVLab / LCL
  [NeurIPS 2024] Vision Model Pre-training on Interleaved Image-Text Data via Latent Compression Learning
  ☆69Updated 2 months ago
• si0wang / VisVM
  ☆40Updated 4 months ago
• foundation-multimodal-models / CAPTURE
  ☆56Updated 9 months ago
• locuslab / llava-token-compression
  ☆41Updated 5 months ago
• OpenGVLab / PVC
  [CVPR 2025] PVC: Progressive Visual Token Compression for Unified Image and Video Processing in Large Vision-Language Models
  ☆39Updated 2 months ago
• huggingface / docmatix
  A huge dataset for Document Visual Question Answering
  ☆18Updated 9 months ago
• opendatalab / CLIP-Parrot-Bias
  ECCV2024_Parrot Captions Teach CLIP to Spot Text
  ☆66Updated 8 months ago
• YukunLi99 / AdaptSAM
  ☆21Updated last year
• AILab-CVC / VL-GPT
  VL-GPT: A Generative Pre-trained Transformer for Vision and Language Understanding and Generation
  ☆86Updated 7 months ago
• OpenGVLab / Mono-InternVL
  [CVPR 2025] Mono-InternVL: Pushing the Boundaries of Monolithic Multimodal Large Language Models with Endogenous Visual Pre-training
  ☆39Updated last month
• joez17 / VideoNIAH
  VideoNIAH: A Flexible Synthetic Method for Benchmarking Video MLLMs
  ☆47Updated last month
• foundation-multimodal-models / CAL
  [NeurIPS'24] Official PyTorch Implementation of Seeing the Image: Prioritizing Visual Correlation by Contrastive Alignment
  ☆56Updated 7 months ago
• Alpha-Innovator / SimChart9K
  The proposed simulated dataset consisting of 9,536 charts and associated data annotations in CSV format.
  ☆24Updated last year
• Share14 / ShareGemini
  ☆30Updated 9 months ago
• NVlabs / QLIP
  [arXiv: 2502.05178] QLIP: Text-Aligned Visual Tokenization Unifies Auto-Regressive Multimodal Understanding and Generation
  ☆69Updated 2 months ago
• ziplab / SN-Netv2
  [ECCV 2024] This is the official implementation of "Stitched ViTs are Flexible Vision Backbones".
  ☆27Updated last year
• om-ai-lab / ZoomEye
  ZoomEye: Enhancing Multimodal LLMs with Human-Like Zooming Capabilities through Tree-Based Image Exploration
  ☆31Updated 4 months ago