allenai / unified-io-inference

Related projects: ⓘ

• mertyg / vision-language-models-are-bows
  Experiments and data for the paper "When and why vision-language models behave like bags-of-words, and what to do about it?" Oral @ ICLR …
  ☆234Updated last year
• google-research / syn-rep-learn
  Learning from synthetic data - code and models
  ☆293Updated 8 months ago
• UCSC-VLAA / CLIPA
  [NeurIPS 2023] This repository includes the official implementation of our paper "An Inverse Scaling Law for CLIP Training"
  ☆292Updated 3 months ago
• LAION-AI / scaling-laws-openclip
  Reproducible scaling laws for contrastive language-image learning (https://arxiv.org/abs/2212.07143)
  ☆149Updated 9 months ago
• facebookresearch / DCI
  Densely Captioned Images (DCI) dataset repository.
  ☆155Updated 2 months ago
• amazon-science / prompt-pretraining
  Official implementation for the paper "Prompt Pre-Training with Over Twenty-Thousand Classes for Open-Vocabulary Visual Recognition"
  ☆251Updated 4 months ago
• ylsung / VL_adapter
  PyTorch code for "VL-Adapter: Parameter-Efficient Transfer Learning for Vision-and-Language Tasks" (CVPR2022)
  ☆202Updated last year
• LijieFan / LaCLIP
  [NeurIPS 2023] Text data, code and pre-trained models for paper "Improving CLIP Training with Language Rewrites"
  ☆251Updated 8 months ago
• fundamentalvision / Uni-Perceiver
  ☆266Updated last year
• IntelLabs / VL-InterpreT
  Visual Language Transformer Interpreter - An interactive visualization tool for interpreting vision-language transformers
  ☆85Updated last year
• TRI-ML / vlm-evaluation
  VLM Evaluation: Benchmark for VLMs, spanning text generation tasks from VQA to Captioning
  ☆77Updated last week
• bfshi / scaling_on_scales
  When do we not need larger vision models?
  ☆314Updated last month
• AILab-CVC / SEED-Bench
  (CVPR2024)A benchmark for evaluating Multimodal LLMs using multiple-choice questions.
  ☆303Updated 2 months ago
• tsb0601 / MMVP
  ☆277Updated 7 months ago
• facebookresearch / diht
  Filtering, Distillation, and Hard Negatives for Vision-Language Pre-Training
  ☆130Updated last year
• google-deepmind / perception_test
  ☆184Updated 2 weeks ago
• amirbar / visual_prompting
  Official implementation and data release of the paper "Visual Prompting via Image Inpainting".
  ☆294Updated last year
• FuxiaoLiu / LRV-Instruction
  [ICLR'24] Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction Tuning
  ☆244Updated 6 months ago
• yossigandelsman / clip_text_span
  official implementation of "Interpreting CLIP's Image Representation via Text-Based Decomposition"
  ☆149Updated this week
• BAAI-DCAI / Visual-Instruction-Tuning
  SVIT: Scaling up Visual Instruction Tuning
  ☆159Updated 3 months ago
• goel-shashank / CyCLIP
  ☆111Updated last year
• phellonchen / awesome-Vision-and-Language-Pre-training
  Recent Advances in Vision and Language Pre-training (VLP)
  ☆287Updated last year
• yuweihao / MM-Vet
  MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilities (ICML 2024)
  ☆252Updated 3 weeks ago
• facebookresearch / meru
  Code for the paper "Hyperbolic Image-Text Representations", Desai et al, ICML 2023
  ☆127Updated last year
• mbanani / lgssl
  [CVPR 2023] Learning Visual Representations via Language-Guided Sampling
  ☆142Updated last year
• allenai / gpv-1
  A task-agnostic vision-language architecture as a step towards General Purpose Vision
  ☆92Updated 3 years ago
• allenai / unified-io-2.pytorch
  ☆60Updated 2 months ago
• kohjingyu / fromage
  🧀 Code and models for the ICML 2023 paper "Grounding Language Models to Images for Multimodal Inputs and Outputs".
  ☆473Updated 10 months ago
• Understanding-Visual-Datasets / VisDiff
  Official implementation of "Describing Differences in Image Sets with Natural Language" (CVPR 2024 Oral)
  ☆97Updated 5 months ago
• ZhangYuanhan-AI / NOAH
  [TPAMI] Searching prompt modules for parameter-efficient transfer learning.
  ☆216Updated 9 months ago