Alternatives and similar repositories for unified-io-inference:

Users that are interested in unified-io-inference are comparing it to the libraries listed below

• amazon-science / prompt-pretraining
  Official implementation for the paper "Prompt Pre-Training with Over Twenty-Thousand Classes for Open-Vocabulary Visual Recognition"
  ☆255Updated 8 months ago
• google-research / syn-rep-learn
  Learning from synthetic data - code and models
  ☆307Updated last year
• tsb0601 / MMVP
  ☆305Updated 11 months ago
• fundamentalvision / Uni-Perceiver
  ☆271Updated 2 years ago
• LAION-AI / scaling-laws-openclip
  Reproducible scaling laws for contrastive language-image learning (https://arxiv.org/abs/2212.07143)
  ☆158Updated last year
• AILab-CVC / SEED-Bench
  (CVPR2024)A benchmark for evaluating Multimodal LLMs using multiple-choice questions.
  ☆324Updated this week
• amirbar / visual_prompting
  Official implementation and data release of the paper "Visual Prompting via Image Inpainting".
  ☆305Updated last year
• UCSC-VLAA / CLIPA
  [NeurIPS 2023] This repository includes the official implementation of our paper "An Inverse Scaling Law for CLIP Training"
  ☆306Updated 7 months ago
• microsoft / FIBER
  Coarse-to-Fine Vision-Language Pre-training with Fusion in the Backbone
  ☆127Updated last year
• VT-NLP / MultiInstruct
  MultiInstruct: Improving Multi-Modal Zero-Shot Learning via Instruction Tuning
  ☆134Updated last year
• ylsung / VL_adapter
  PyTorch code for "VL-Adapter: Parameter-Efficient Transfer Learning for Vision-and-Language Tasks" (CVPR2022)
  ☆204Updated 2 years ago
• BAAI-DCAI / Visual-Instruction-Tuning
  SVIT: Scaling up Visual Instruction Tuning
  ☆164Updated 7 months ago
• IntelLabs / VL-InterpreT
  Visual Language Transformer Interpreter - An interactive visualization tool for interpreting vision-language transformers
  ☆86Updated last year
• mertyg / vision-language-models-are-bows
  Experiments and data for the paper "When and why vision-language models behave like bags-of-words, and what to do about it?" Oral @ ICLR …
  ☆263Updated last year
• facebookresearch / DCI
  Densely Captioned Images (DCI) dataset repository.
  ☆167Updated 6 months ago
• mlfoundations / patching
  Patching open-vocabulary models by interpolating weights
  ☆91Updated last year
• google-deepmind / perception_test
  ☆197Updated 4 months ago
• zeyofu / BLINK_Benchmark
  This repo contains evaluation code for the paper "BLINK: Multimodal Large Language Models Can See but Not Perceive". https://arxiv.or…
  ☆112Updated 6 months ago
• cambridgeltl / visual-spatial-reasoning
  [TACL'23] VSR: A probing benchmark for spatial undersranding of vision-language models.
  ☆108Updated last year
• FuxiaoLiu / LRV-Instruction
  [ICLR'24] Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction Tuning
  ☆267Updated 10 months ago
• RAIVNLab / sugar-crepe
  [NeurIPS 2023] A faithful benchmark for vision-language compositionality
  ☆75Updated 11 months ago
• allenai / unified-io-2.pytorch
  ☆67Updated 6 months ago
• Understanding-Visual-Datasets / VisDiff
  Official implementation of "Describing Differences in Image Sets with Natural Language" (CVPR 2024 Oral)
  ☆112Updated 9 months ago
• sail-sg / ptp
  [CVPR2023] The code for 《Position-guided Text Prompt for Vision-Language Pre-training》
  ☆150Updated last year
• igorbrigadir / DownloadConceptualCaptions
  Reliably download millions of images efficiently
  ☆113Updated 3 years ago
• facebookresearch / meru
  Code for the paper "Hyperbolic Image-Text Representations", Desai et al, ICML 2023
  ☆146Updated last year
• phellonchen / awesome-Vision-and-Language-Pre-training
  Recent Advances in Vision and Language Pre-training (VLP)
  ☆290Updated last year
• yossigandelsman / clip_text_span
  official implementation of "Interpreting CLIP's Image Representation via Text-Based Decomposition"
  ☆184Updated last month
• bfshi / TOAST
  Official code for "TOAST: Transfer Learning via Attention Steering"
  ☆186Updated last year
• LijieFan / LaCLIP
  [NeurIPS 2023] Text data, code and pre-trained models for paper "Improving CLIP Training with Language Rewrites"
  ☆264Updated last year