Alternatives and similar repositories for unified-io-inference

Users that are interested in unified-io-inference are comparing it to the libraries listed below

• allenai / unified-io-2

  View on GitHub
  ☆643Feb 15, 2024Updated 2 years ago
• microsoft / X-Decoder

  View on GitHub
  [CVPR 2023] Official Implementation of X-Decoder for generalized decoding for pixel, image and language
  ☆1,342Oct 5, 2023Updated 2 years ago
• OFA-Sys / OFA

  View on GitHub
  Official repository of OFA (ICML 2022). Paper: OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence L…
  ☆2,555Apr 24, 2024Updated last year
• microsoft / UniTAB

  View on GitHub
  UniTAB: Unifying Text and Box Outputs for Grounded VL Modeling, ECCV 2022 (Oral Presentation)
  ☆89Jun 12, 2023Updated 2 years ago
• TencentARC / GVT

  View on GitHub
  Official code for "What Makes for Good Visual Tokenizers for Large Language Models?".
  ☆58Jun 27, 2023Updated 2 years ago
• JialianW / GRiT

  View on GitHub
  GRiT: A Generative Region-to-text Transformer for Object Understanding (ECCV2024)
  ☆340Jan 8, 2024Updated 2 years ago
• allenai / mmc4

  View on GitHub
  MultimodalC4 is a multimodal extension of c4 that interleaves millions of images with text.
  ☆952Mar 19, 2025Updated 10 months ago
• ylsung / VL_adapter

  View on GitHub
  PyTorch code for "VL-Adapter: Parameter-Efficient Transfer Learning for Vision-and-Language Tasks" (CVPR2022)
  ☆209Dec 18, 2022Updated 3 years ago
• allenai / unified-io-2.pytorch

  View on GitHub
  ☆80Jul 3, 2024Updated last year
• Buzz-Beater / EgoTaskQA

  View on GitHub
  Code for NeurIPS 2022 Datasets and Benchmarks paper - EgoTaskQA: Understanding Human Tasks in Egocentric Videos.
  ☆37Apr 17, 2023Updated 2 years ago
• mlfoundations / open_flamingo

  View on GitHub
  An open-source framework for training large multimodal models.
  ☆4,066Aug 31, 2024Updated last year
• google-research / pix2seq

  View on GitHub
  Pix2Seq codebase: multi-tasks with generative modeling (autoregressive and diffusion)
  ☆939Nov 7, 2023Updated 2 years ago
• jiasenlu / LL3M

  View on GitHub
  LL3M: Large Language and Multi-Modal Model in Jax
  ☆74Apr 23, 2024Updated last year
• amirbar / visual_prompting

  View on GitHub
  Official implementation and data release of the paper "Visual Prompting via Image Inpainting".
  ☆318Aug 7, 2023Updated 2 years ago
• jshilong / GPT4RoI

  View on GitHub
  (ECCVW 2025)GPT4RoI: Instruction Tuning Large Language Model on Region-of-Interest
  ☆551Jun 3, 2025Updated 8 months ago
• Vision-CAIR / ChatCaptioner

  View on GitHub
  Official Repository of ChatCaptioner
  ☆467Apr 13, 2023Updated 2 years ago
• baaivision / Emu

  View on GitHub
  Emu Series: Generative Multimodal Models from BAAI
  ☆1,765Jan 12, 2026Updated last month
• AILab-CVC / SEED

  View on GitHub
  Official implementation of SEED-LLaMA (ICLR 2024).
  ☆639Sep 21, 2024Updated last year
• allenai / gpv-1

  View on GitHub
  A task-agnostic vision-language architecture as a step towards General Purpose Vision
  ☆92Jul 14, 2021Updated 4 years ago
• open-mmlab / Multimodal-GPT

  View on GitHub
  Multimodal-GPT
  ☆1,518Jun 4, 2023Updated 2 years ago
• OpenGVLab / all-seeing

  View on GitHub
  [ICLR 2024 & ECCV 2024] The All-Seeing Projects: Towards Panoptic Visual Recognition&Understanding and General Relation Comprehension of …
  ☆504Aug 9, 2024Updated last year
• microsoft / GLIP

  View on GitHub
  Grounded Language-Image Pre-training
  ☆2,573Jan 24, 2024Updated 2 years ago
• Victorwz / VaLM

  View on GitHub
  VaLM: Visually-augmented Language Modeling. ICLR 2023.
  ☆56Mar 6, 2023Updated 2 years ago
• mhh0318 / UniD3

  View on GitHub
  ☆55Feb 9, 2023Updated 3 years ago
• salesforce / LAVIS

  View on GitHub
  LAVIS - A One-stop Library for Language-Vision Intelligence
  ☆11,166Nov 18, 2024Updated last year
• RunpeiDong / DreamLLM

  View on GitHub
  [ICLR 2024 Spotlight] DreamLLM: Synergistic Multimodal Comprehension and Creation
  ☆458Dec 2, 2024Updated last year
• fundamentalvision / Uni-Perceiver

  View on GitHub
  ☆285Aug 14, 2025Updated 6 months ago
• facebookresearch / long_seq_mae

  View on GitHub
  code release of research paper "Exploring Long-Sequence Masked Autoencoders"
  ☆100Oct 14, 2022Updated 3 years ago
• mbanani / lgssl

  View on GitHub
  [CVPR 2023] Learning Visual Representations via Language-Guided Sampling
  ☆149Apr 13, 2023Updated 2 years ago
• e-bug / fine-grained-evals

  View on GitHub
  [ACL 2023] Code and data for our paper "Measuring Progress in Fine-grained Vision-and-Language Understanding"
  ☆13Jun 11, 2023Updated 2 years ago
• zdou0830 / METER

  View on GitHub
  METER: A Multimodal End-to-end TransformER Framework
  ☆375Nov 16, 2022Updated 3 years ago
• EPFL-VILAB / MultiMAE

  View on GitHub
  MultiMAE: Multi-modal Multi-task Masked Autoencoders, ECCV 2022
  ☆614Dec 13, 2022Updated 3 years ago
• baaivision / Painter

  View on GitHub
  Painter & SegGPT Series: Vision Foundation Models from BAAI
  ☆2,592Dec 6, 2024Updated last year
• HaozheZhao / MIC

  View on GitHub
  MMICL, a state-of-the-art VLM with the in context learning ability from ICL, PKU
  ☆360Dec 18, 2023Updated 2 years ago
• baaivision / EVA

  View on GitHub
  EVA Series: Visual Representation Fantasies from BAAI
  ☆2,648Aug 1, 2024Updated last year
• allenai / visprog

  View on GitHub
  Official code for VisProg (CVPR 2023 Best Paper!)
  ☆759Aug 26, 2024Updated last year
• microsoft / GenerativeImage2Text

  View on GitHub
  GIT: A Generative Image-to-text Transformer for Vision and Language
  ☆580Dec 2, 2023Updated 2 years ago
• SwinTransformer / AiT

  View on GitHub
  ☆110Jun 30, 2023Updated 2 years ago
• bytedance / ibot

  View on GitHub
  iBOT : Image BERT Pre-Training with Online Tokenizer (ICLR 2022)
  ☆764Apr 14, 2022Updated 3 years ago