Alternatives and similar repositories for wit:

Users that are interested in wit are comparing it to the libraries listed below

• FreddeFrallan / Multilingual-CLIP
  OpenAI CLIP text encoders for multiple languages!
  ☆778Updated last year
• lucidrains / flamingo-pytorch
  Implementation of 🦩 Flamingo, state-of-the-art few-shot visual question answering attention net out of Deepmind, in Pytorch
  ☆1,228Updated 2 years ago
• Zasder3 / train-CLIP
  A PyTorch Lightning solution to training OpenAI's CLIP from scratch.
  ☆677Updated 2 years ago
• lucidrains / x-clip
  A concise but complete implementation of CLIP with various experimental improvements from recent papers
  ☆705Updated last year
• google-research-datasets / conceptual-12m
  Conceptual 12M is a dataset containing (image-URL, caption) pairs collected for vision-and-language pre-training.
  ☆377Updated last year
• facebookresearch / SLIP
  Code release for SLIP Self-supervision meets Language-Image Pre-training
  ☆754Updated last year
• microsoft / Oscar
  Oscar and VinVL
  ☆1,040Updated last year
• kohjingyu / fromage
  🧀 Code and models for the ICML 2023 paper "Grounding Language Models to Images for Multimodal Inputs and Outputs".
  ☆478Updated last year
• jayleicn / ClipBERT
  [CVPR 2021 Best Student Paper Honorable Mention, Oral] Official PyTorch code for ClipBERT, an efficient framework for end-to-end learning…
  ☆713Updated last year
• ashkamath / mdetr
  ☆985Updated 2 years ago
• facebookresearch / vilbert-multi-task
  Multi Task Vision and Language
  ☆803Updated 2 years ago
• Sense-GVT / DeCLIP
  Supervision Exists Everywhere: A Data Efficient Contrastive Language-Image Pre-training Paradigm
  ☆643Updated 2 years ago
• lucidrains / RETRO-pytorch
  Implementation of RETRO, Deepmind's Retrieval based Attention net, in Pytorch
  ☆857Updated last year
• ChenRocks / UNITER
  Research code for ECCV 2020 paper "UNITER: UNiversal Image-TExt Representation Learning"
  ☆788Updated 3 years ago
• facebookresearch / multimodal
  TorchMultimodal is a PyTorch library for training state-of-the-art multimodal multi-task models at scale.
  ☆1,527Updated this week
• yxuansu / MAGIC
  Language Models Can See: Plugging Visual Controls in Text Generation
  ☆257Updated 2 years ago
• allenai / mmc4
  MultimodalC4 is a multimodal extension of c4 that interleaves millions of images with text.
  ☆916Updated 7 months ago
• mlfoundations / wise-ft
  Robust fine-tuning of zero-shot models
  ☆665Updated 2 years ago
• pzzhang / VinVL
  project page for VinVL
  ☆351Updated last year
• salesforce / ALBEF
  Code for ALBEF: a new vision-language pre-training method
  ☆1,599Updated 2 years ago
• LAION-AI / CLIP_benchmark
  CLIP-like model evaluation
  ☆656Updated 5 months ago
• xplip / pixel
  Research code for pixel-based encoders of language (PIXEL)
  ☆334Updated 10 months ago
• yuewang-cuhk / awesome-vision-language-pretraining-papers
  Recent Advances in Vision and Language PreTrained Models (VL-PTMs)
  ☆1,148Updated 2 years ago
• OFA-Sys / OFA
  Official repository of OFA (ICML 2022). Paper: OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence L…
  ☆2,453Updated 9 months ago
• google-research-datasets / conceptual-captions
  Conceptual Captions is a dataset containing (image-URL, caption) pairs designed for the training and evaluation of machine learned image …
  ☆526Updated 3 years ago
• clip-vil / CLIP-ViL
  [ICLR 2022] code for "How Much Can CLIP Benefit Vision-and-Language Tasks?" https://arxiv.org/abs/2107.06383
  ☆409Updated 2 years ago
• criteo / autofaiss
  Automatically create Faiss knn indices with the most optimal similarity search parameters.
  ☆830Updated 8 months ago
• kakaobrain / coyo-dataset
  COYO-700M: Large-scale Image-Text Pair Dataset
  ☆1,196Updated 2 years ago
• microsoft / GenerativeImage2Text
  GIT: A Generative Image-to-text Transformer for Vision and Language
  ☆555Updated last year
• google-research / byt5
  ☆490Updated 11 months ago