Alternatives and similar repositories for OFA:

Users that are interested in OFA are comparing it to the libraries listed below

• salesforce / ALBEF
  Code for ALBEF: a new vision-language pre-training method
  ☆1,598Updated 2 years ago
• salesforce / BLIP
  PyTorch code for BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation
  ☆4,968Updated 5 months ago
• dandelin / ViLT
  Code for the ICML 2021 (long talk) paper: "ViLT: Vision-and-Language Transformer Without Convolution or Region Supervision"
  ☆1,427Updated 9 months ago
• lucidrains / flamingo-pytorch
  Implementation of 🦩 Flamingo, state-of-the-art few-shot visual question answering attention net out of Deepmind, in Pytorch
  ☆1,227Updated 2 years ago
• microsoft / GLIP
  Grounded Language-Image Pre-training
  ☆2,297Updated 11 months ago
• baaivision / EVA
  EVA Series: Visual Representation Fantasies from BAAI
  ☆2,381Updated 5 months ago
• facebookresearch / multimodal
  TorchMultimodal is a PyTorch library for training state-of-the-art multimodal multi-task models at scale.
  ☆1,519Updated this week
• mlfoundations / open_clip
  An open source implementation of CLIP.
  ☆10,804Updated last week
• lucidrains / CoCa-pytorch
  Implementation of CoCa, Contrastive Captioners are Image-Text Foundation Models, in Pytorch
  ☆1,092Updated last year
• mlfoundations / open_flamingo
  An open-source framework for training large multimodal models.
  ☆3,801Updated 4 months ago
• rom1504 / clip-retrieval
  Easily compute clip embeddings and build a clip retrieval system with them
  ☆2,475Updated 9 months ago
• rom1504 / img2dataset
  Easily turn large sets of image urls to an image dataset. Can download, resize and package 100M urls in 20h on one machine.
  ☆3,848Updated 5 months ago
• rmokady / CLIP_prefix_caption
  Simple image captioning model
  ☆1,334Updated 7 months ago
• salesforce / LAVIS
  LAVIS - A One-stop Library for Language-Vision Intelligence
  ☆10,161Updated last month
• KaiyangZhou / CoOp
  Prompt Learning for Vision-Language Models (IJCV'22, CVPR'22)
  ☆1,854Updated 7 months ago
• yzhuoning / Awesome-CLIP
  Awesome list for research on CLIP (Contrastive Language-Image Pre-Training).
  ☆1,163Updated 6 months ago
• microsoft / GenerativeImage2Text
  GIT: A Generative Image-to-text Transformer for Vision and Language
  ☆555Updated last year
• ArrowLuo / CLIP4Clip
  An official implementation for "CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval"
  ☆904Updated 9 months ago
• OFA-Sys / ONE-PEACE
  A general representation model across vision, audio, language modalities. Paper: ONE-PEACE: Exploring One General Representation Model To…
  ☆1,005Updated 3 months ago
• Zasder3 / train-CLIP
  A PyTorch Lightning solution to training OpenAI's CLIP from scratch.
  ☆676Updated 2 years ago
• open-mmlab / Multimodal-GPT
  Multimodal-GPT
  ☆1,488Updated last year
• zengyan-97 / X-VLM
  X-VLM: Multi-Grained Vision Language Pre-Training (ICML 2022)
  ☆462Updated 2 years ago
• yuewang-cuhk / awesome-vision-language-pretraining-papers
  Recent Advances in Vision and Language PreTrained Models (VL-PTMs)
  ☆1,148Updated 2 years ago
• mlfoundations / wise-ft
  Robust fine-tuning of zero-shot models
  ☆667Updated 2 years ago
• Sense-GVT / DeCLIP
  Supervision Exists Everywhere: A Data Efficient Contrastive Language-Image Pre-training Paradigm
  ☆642Updated 2 years ago
• microsoft / X-Decoder
  [CVPR 2023] Official Implementation of X-Decoder for generalized decoding for pixel, image and language
  ☆1,297Updated last year
• google-research / big_vision
  Official codebase used to develop Vision Transformer, SigLIP, MLP-Mixer, LiT and more.
  ☆2,516Updated 3 weeks ago
• OpenGVLab / InternVideo
  [ECCV2024] Video Foundation Models & Data for Multimodal Understanding
  ☆1,553Updated this week
• FreddeFrallan / Multilingual-CLIP
  OpenAI CLIP text encoders for multiple languages!
  ☆773Updated last year
• thu-ml / unidiffuser
  Code and models for the paper "One Transformer Fits All Distributions in Multi-Modal Diffusion"
  ☆1,394Updated last year