Alternatives and similar repositories for unified-io-inference:

Users that are interested in unified-io-inference are comparing it to the libraries listed below

• mertyg / vision-language-models-are-bows
  Experiments and data for the paper "When and why vision-language models behave like bags-of-words, and what to do about it?" Oral @ ICLR …
  ☆270Updated last year
• facebookresearch / DCI
  Densely Captioned Images (DCI) dataset repository.
  ☆172Updated 8 months ago
• LAION-AI / scaling-laws-openclip
  Reproducible scaling laws for contrastive language-image learning (https://arxiv.org/abs/2212.07143)
  ☆160Updated last year
• cambridgeltl / visual-spatial-reasoning
  [TACL'23] VSR: A probing benchmark for spatial undersranding of vision-language models.
  ☆116Updated last year
• UCSC-VLAA / CLIPA
  [NeurIPS 2023] This repository includes the official implementation of our paper "An Inverse Scaling Law for CLIP Training"
  ☆312Updated 9 months ago
• google-research / syn-rep-learn
  Learning from synthetic data - code and models
  ☆313Updated last year
• facebookresearch / diht
  Filtering, Distillation, and Hard Negatives for Vision-Language Pre-Training
  ☆136Updated 2 years ago
• microsoft / FIBER
  Coarse-to-Fine Vision-Language Pre-training with Fusion in the Backbone
  ☆128Updated last year
• google-deepmind / perception_test
  ☆203Updated 6 months ago
• ylsung / VL_adapter
  PyTorch code for "VL-Adapter: Parameter-Efficient Transfer Learning for Vision-and-Language Tasks" (CVPR2022)
  ☆204Updated 2 years ago
• RAIVNLab / sugar-crepe
  [NeurIPS 2023] A faithful benchmark for vision-language compositionality
  ☆77Updated last year
• amirbar / visual_prompting
  Official implementation and data release of the paper "Visual Prompting via Image Inpainting".
  ☆307Updated last year
• BAAI-DCAI / Visual-Instruction-Tuning
  SVIT: Scaling up Visual Instruction Tuning
  ☆164Updated 9 months ago
• tsb0601 / MMVP
  ☆319Updated last year
• allenai / gpv-1
  A task-agnostic vision-language architecture as a step towards General Purpose Vision
  ☆92Updated 3 years ago
• allenai / unified-io-2.pytorch
  ☆71Updated 8 months ago
• amazon-science / prompt-pretraining
  Official implementation for the paper "Prompt Pre-Training with Over Twenty-Thousand Classes for Open-Vocabulary Visual Recognition"
  ☆257Updated 10 months ago
• Understanding-Visual-Datasets / VisDiff
  Official implementation of "Describing Differences in Image Sets with Natural Language" (CVPR 2024 Oral)
  ☆114Updated 11 months ago
• phellonchen / awesome-Vision-and-Language-Pre-training
  Recent Advances in Vision and Language Pre-training (VLP)
  ☆293Updated last year
• LijieFan / LaCLIP
  [NeurIPS 2023] Text data, code and pre-trained models for paper "Improving CLIP Training with Language Rewrites"
  ☆270Updated last year
• rowanz / merlot
  MERLOT: Multimodal Neural Script Knowledge Models
  ☆223Updated 3 years ago
• Yushi-Hu / tifa
  TIFA: Accurate and Interpretable Text-to-Image Faithfulness Evaluation with Question Answering
  ☆156Updated 10 months ago
• VT-NLP / MultiInstruct
  MultiInstruct: Improving Multi-Modal Zero-Shot Learning via Instruction Tuning
  ☆136Updated last year
• fundamentalvision / Uni-Perceiver
  ☆272Updated 2 years ago
• IntelLabs / VL-InterpreT
  Visual Language Transformer Interpreter - An interactive visualization tool for interpreting vision-language transformers
  ☆90Updated last year
• sail-sg / ptp
  [CVPR2023] The code for 《Position-guided Text Prompt for Vision-Language Pre-training》
  ☆151Updated last year
• allenai / aokvqa
  Official repository for the A-OKVQA dataset
  ☆79Updated 10 months ago
• goel-shashank / CyCLIP
  ☆117Updated 2 years ago
• sanjayss34 / codevqa
  ☆83Updated last year
• yuweihao / MM-Vet
  MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilities (ICML 2024)
  ☆291Updated 2 months ago