Alternatives and similar repositories for zero-shot-image-to-text

Users that are interested in zero-shot-image-to-text are comparing it to the libraries listed below

• yxuansu / MAGIC

  View on GitHub
  Language Models Can See: Plugging Visual Controls in Text Generation
  ☆259Jun 1, 2022Updated 3 years ago
• YoadTew / zero-shot-video-to-text

  View on GitHub
  ☆76Oct 22, 2022Updated 3 years ago
• DavidHuji / CapDec

  View on GitHub
  CapDec: SOTA Zero Shot Image Captioning Using CLIP and GPT2, EMNLP 2022 (findings)
  ☆203Jan 28, 2024Updated 2 years ago
• dhg-wei / DeCap

  View on GitHub
  ICLR 2023 DeCap: Decoding CLIP Latents for Zero-shot Captioning
  ☆138Mar 16, 2023Updated 2 years ago
• MIMICLab / L-Verse

  View on GitHub
  L-Verse: Bidirectional Generation Between Image and Text
  ☆107Apr 1, 2025Updated 10 months ago
• rmokady / CLIP_prefix_caption

  View on GitHub
  Simple image captioning model
  ☆1,408Jun 9, 2024Updated last year
• mehdidc / feed_forward_vqgan_clip

  View on GitHub
  Feed forward VQGAN-CLIP model, where the goal is to eliminate the need for optimizing the latent space of VQGAN for each input prompt
  ☆140Jan 3, 2024Updated 2 years ago
• joeyz0z / ConZIC

  View on GitHub
  Official implementation of "ConZIC: Controllable Zero-shot Image Captioning by Sampling-Based Polishing"
  ☆75Sep 20, 2023Updated 2 years ago
• allenai / close

  View on GitHub
  ☆59Aug 30, 2023Updated 2 years ago
• CompVis / imagebart

  View on GitHub
  ImageBART: Bidirectional Context with Multinomial Diffusion for Autoregressive Image Synthesis
  ☆125Mar 14, 2022Updated 3 years ago
• clip-vil / CLIP-ViL

  View on GitHub
  [ICLR 2022] code for "How Much Can CLIP Benefit Vision-and-Language Tasks?" https://arxiv.org/abs/2107.06383
  ☆421Oct 28, 2022Updated 3 years ago
• allenai / reclip

  View on GitHub
  ☆86Apr 15, 2022Updated 3 years ago
• DavidMChan / caption-by-committee

  View on GitHub
  Using LLMs and pre-trained caption models for super-human performance on image captioning.
  ☆42Oct 13, 2023Updated 2 years ago
• ylsung / VL_adapter

  View on GitHub
  PyTorch code for "VL-Adapter: Parameter-Efficient Transfer Learning for Vision-and-Language Tasks" (CVPR2022)
  ☆209Dec 18, 2022Updated 3 years ago
• Sense-GVT / DeCLIP

  View on GitHub
  Supervision Exists Everywhere: A Data Efficient Contrastive Language-Image Pre-training Paradigm
  ☆673Sep 19, 2022Updated 3 years ago
• facebookresearch / SLIP

  View on GitHub
  Code release for SLIP Self-supervision meets Language-Image Pre-training
  ☆787Feb 9, 2023Updated 3 years ago
• OdedH / textual-pca

  View on GitHub
  Official implementation of "Describing Sets of Images with Textual-PCA".
  ☆16Feb 13, 2023Updated 3 years ago
• CompVis / visual-search

  View on GitHub
  Visual search interface
  ☆11Nov 30, 2021Updated 4 years ago
• joeyz0z / MeaCap

  View on GitHub
  (CVPR2024) MeaCap: Memory-Augmented Zero-shot Image Captioning
  ☆55Aug 16, 2024Updated last year
• bearcatt / LaBERT

  View on GitHub
  A length-controllable and non-autoregressive image captioning model.
  ☆69Jun 10, 2021Updated 4 years ago
• pbaylies / Augmented_CLIP

  View on GitHub
  Training simple models to predict CLIP image embeddings from text embeddings, and vice versa.
  ☆60Mar 31, 2022Updated 3 years ago
• NVlabs / GroupViT

  View on GitHub
  Official PyTorch implementation of GroupViT: Semantic Segmentation Emerges from Text Supervision, CVPR 2022.
  ☆781May 10, 2022Updated 3 years ago
• ShiYaya / emscore

  View on GitHub
  Research code for CVPR 2022 paper: "EMScore: Evaluating Video Captioning via Coarse-Grained and Fine-Grained Embedding Matching"
  ☆26Oct 20, 2022Updated 3 years ago
• learning-at-home / dalle-hivemind

  View on GitHub
  Training a model similar to OpenAI DALL-E with volunteers from all over the Internet using hivemind and dalle-pytorch (NeurIPS 2021 demo)
  ☆27May 29, 2023Updated 2 years ago
• j-min / CLIP-Caption-Reward

  View on GitHub
  PyTorch code for "Fine-grained Image Captioning with CLIP Reward" (Findings of NAACL 2022)
  ☆246Jun 10, 2025Updated 8 months ago
• hila-chefer / Transformer-MM-Explainability

  View on GitHub
  [ICCV 2021- Oral] Official PyTorch implementation for Generic Attention-model Explainability for Interpreting Bi-Modal and Encoder-Decode…
  ☆900Aug 24, 2023Updated 2 years ago
• amitakamath / vl_text_encoders_are_bottlenecks

  View on GitHub
  Code and datasets for "Text encoders are performance bottlenecks in contrastive vision-language models". Coming soon!
  ☆11May 24, 2023Updated 2 years ago
• LuoweiZhou / coco-caption

  View on GitHub
  kdexd/coco-caption@de6f385
  ☆26Apr 21, 2020Updated 5 years ago
• mzhaoshuai / CenterCLIP

  View on GitHub
  [SIGIR 2022] CenterCLIP: Token Clustering for Efficient Text-Video Retrieval.
  ☆134May 4, 2022Updated 3 years ago
• zhangxuying1004 / RSTNet

  View on GitHub
  Official Code for 'RSTNet: Captioning with Adaptive Attention on Visual and Non-Visual Words' (CVPR 2021)
  ☆123Dec 17, 2022Updated 3 years ago
• LeeYN-43 / Clover

  View on GitHub
  Offical PyTorch implementation of Clover: Towards A Unified Video-Language Alignment and Fusion Model (CVPR2023)
  ☆40Feb 15, 2023Updated 2 years ago
• microsoft / UniCL

  View on GitHub
  [CVPR 2022] Official code for "Unified Contrastive Learning in Image-Text-Label Space"
  ☆405Nov 10, 2023Updated 2 years ago
• mlfoundations / patching

  View on GitHub
  Patching open-vocabulary models by interpolating weights
  ☆91Sep 28, 2023Updated 2 years ago
• NightmareAI / majesty-diffusion

  View on GitHub
  Majesty Diffusion by @Dango233 and @apolinario (@multimodalart)
  ☆25Jul 26, 2022Updated 3 years ago
• researchmm / generate-it

  View on GitHub
  A collection of models for image<->text generation in ACM MM 2021.
  ☆67Oct 31, 2021Updated 4 years ago
• woojeongjin / FewVLM

  View on GitHub
  A Good Prompt Is Worth Millions of Parameters: Low-resource Prompt-based Learning for Vision-Language Models (ACL 2022)
  ☆43May 13, 2022Updated 3 years ago
• yangbang18 / MultiCapCLIP

  View on GitHub
  (ACL'2023) MultiCapCLIP: Auto-Encoding Prompts for Zero-Shot Multilingual Visual Captioning
  ☆36Aug 8, 2024Updated last year
• kakaobrain / mindall-e

  View on GitHub
  PyTorch implementation of a 1.3B text-to-image generation model trained on 14 million image-text pairs
  ☆634Aug 9, 2022Updated 3 years ago
• OFA-Sys / OFA

  View on GitHub
  Official repository of OFA (ICML 2022). Paper: OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence L…
  ☆2,555Apr 24, 2024Updated last year