Alternatives and similar repositories for OFA

Users that are interested in OFA are comparing it to the libraries listed below

• salesforce / ALBEF
  Code for ALBEF: a new vision-language pre-training method
  ☆1,701Updated 2 years ago
• lucidrains / flamingo-pytorch
  Implementation of 🦩 Flamingo, state-of-the-art few-shot visual question answering attention net out of Deepmind, in Pytorch
  ☆1,261Updated 2 years ago
• lucidrains / CoCa-pytorch
  Implementation of CoCa, Contrastive Captioners are Image-Text Foundation Models, in Pytorch
  ☆1,177Updated last year
• salesforce / BLIP
  PyTorch code for BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation
  ☆5,476Updated last year
• microsoft / GLIP
  Grounded Language-Image Pre-training
  ☆2,495Updated last year
• dandelin / ViLT
  Code for the ICML 2021 (long talk) paper: "ViLT: Vision-and-Language Transformer Without Convolution or Region Supervision"
  ☆1,493Updated last year
• baaivision / EVA
  EVA Series: Visual Representation Fantasies from BAAI
  ☆2,567Updated last year
• rmokady / CLIP_prefix_caption
  Simple image captioning model
  ☆1,392Updated last year
• yzhuoning / Awesome-CLIP
  Awesome list for research on CLIP (Contrastive Language-Image Pre-Training).
  ☆1,213Updated last year
• mlfoundations / open_flamingo
  An open-source framework for training large multimodal models.
  ☆4,005Updated last year
• microsoft / GenerativeImage2Text
  GIT: A Generative Image-to-text Transformer for Vision and Language
  ☆572Updated last year
• facebookresearch / multimodal
  TorchMultimodal is a PyTorch library for training state-of-the-art multimodal multi-task models at scale.
  ☆1,648Updated last week
• rom1504 / clip-retrieval
  Easily compute clip embeddings and build a clip retrieval system with them
  ☆2,642Updated last month
• Zasder3 / train-CLIP
  A PyTorch Lightning solution to training OpenAI's CLIP from scratch.
  ☆710Updated 3 years ago
• open-mmlab / Multimodal-GPT
  Multimodal-GPT
  ☆1,509Updated 2 years ago
• OFA-Sys / ONE-PEACE
  A general representation model across vision, audio, language modalities. Paper: ONE-PEACE: Exploring One General Representation Model To…
  ☆1,052Updated 11 months ago
• X-PLUG / mPLUG-Owl
  mPLUG-Owl: The Powerful Multi-modal Large Language Model Family
  ☆2,512Updated 5 months ago
• KaiyangZhou / CoOp
  Prompt Learning for Vision-Language Models (IJCV'22, CVPR'22)
  ☆2,064Updated last year
• FreddeFrallan / Multilingual-CLIP
  OpenAI CLIP text encoders for multiple languages!
  ☆812Updated 2 years ago
• rom1504 / img2dataset
  Easily turn large sets of image urls to an image dataset. Can download, resize and package 100M urls in 20h on one machine.
  ☆4,153Updated this week
• ArrowLuo / CLIP4Clip
  An official implementation for "CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval"
  ☆981Updated last year
• johanmodin / clifs
  Contrastive Language-Image Forensic Search allows free text searching through videos using OpenAI's machine learning model CLIP
  ☆476Updated 3 years ago
• LAION-AI / CLIP_benchmark
  CLIP-like model evaluation
  ☆764Updated last month
• salesforce / LAVIS
  LAVIS - A One-stop Library for Language-Vision Intelligence
  ☆10,889Updated 9 months ago
• Computer-Vision-in-the-Wild / CVinW_Readings
  A collection of papers on the topic of ``Computer Vision in the Wild (CVinW)''
  ☆1,328Updated last year
• thu-ml / unidiffuser
  Code and models for the paper "One Transformer Fits All Distributions in Multi-Modal Diffusion"
  ☆1,435Updated 2 years ago
• mlfoundations / wise-ft
  Robust fine-tuning of zero-shot models
  ☆737Updated 3 years ago
• zengyan-97 / X-VLM
  X-VLM: Multi-Grained Vision Language Pre-Training (ICML 2022)
  ☆483Updated 2 years ago
• shikras / shikra
  ☆795Updated last year
• yuewang-cuhk / awesome-vision-language-pretraining-papers
  Recent Advances in Vision and Language PreTrained Models (VL-PTMs)
  ☆1,156Updated 3 years ago