Alternatives and similar repositories for Image-captioning-ViT

Users that are interested in Image-captioning-ViT are comparing it to the libraries listed below

• zarzouram / image_captioning_with_transformers
  Pytorch implementation of image captioning using transformer-based model.
  ☆66Updated 2 years ago
• senadkurtisi / pytorch-image-captioning
  Transformer & CNN Image Captioning model in PyTorch.
  ☆44Updated 2 years ago
• jianjieluo / OpenAI-CLIP-Feature
  An easy to use, user-friendly and efficient code for extracting OpenAI CLIP (Global/Grid) features from image and text respectively.
  ☆130Updated 7 months ago
• One-paper-luck / PKG-Transformer
  ☆12Updated last year
• Dantekk / Image-Captioning
  Image Captioning using CNN and Transformer.
  ☆54Updated 3 years ago
• zihuixue / DynMM
  Code for the paper 'Dynamic Multimodal Fusion'
  ☆114Updated 2 years ago
• moein-shariatnia / OpenAI-CLIP
  Simple implementation of OpenAI CLIP model in PyTorch.
  ☆700Updated last year
• rmokady / CLIP_prefix_caption
  Simple image captioning model
  ☆1,388Updated last year
• yousefkotp / Visual-Question-Answering
  A Light weight deep learning model with with a web application to answer image-based questions with a non-generative approach for the Viz…
  ☆12Updated 2 years ago
• tezansahu / VQA-With-Multimodal-Transformers
  Exploring multimodal fusion-type transformer models for visual question answering (on DAQUAR dataset)
  ☆36Updated 3 years ago
• davidnvq / grit
  GRIT: Faster and Better Image-captioning Transformer (ECCV 2022)
  ☆195Updated 2 years ago
• Vincent-ZHQ / UniS-MMC
  Code for UniS-MMC: Multimodal Classification via Unimodality-supervised Multimodal Contrastive Learning (ACL 2023)
  ☆36Updated last year
• jchenghu / ExpansionNet_v2
  Implementation code of the work "Exploiting Multiple Sequence Lengths in Fast End to End Training for Image Captioning"
  ☆92Updated 7 months ago
• SatyamGaba / image_captioning
  Image Captioning with CNN, LSTM and RNN using PyTorch on COCO Dataset
  ☆18Updated 5 years ago
• QingyangZhang / QMF
  Quality-aware multimodal fusion on ICML 2023
  ☆109Updated last month
• Henrymachiyu / ProtoViT
  This code implements ProtoViT, a novel approach that combines Vision Transformers with prototype-based learning to create interpretable i…
  ☆25Updated 2 months ago
• all-things-vits / code-samples
  Holds code for our CVPR'23 tutorial: All Things ViTs: Understanding and Interpreting Attention in Vision.
  ☆194Updated 2 years ago
• Peachypie98 / CBAM
  CBAM: Convolutional Block Attention Module for CIFAR100 on VGG19
  ☆54Updated 3 months ago
• jmisilo / clip-gpt-captioning
  CLIPxGPT Captioner is Image Captioning Model based on OpenAI's CLIP and GPT-2.
  ☆117Updated 5 months ago
• isLinXu / paper-list
  autoupdate paper list
  ☆91Updated this week
• IBM / CrossViT
  Official implementation of CrossViT. https://arxiv.org/abs/2103.14899
  ☆400Updated 3 years ago
• bubbliiiing / clip-pytorch
  这是一个clip-pytorch的模型，可以训练自己的数据集。
  ☆238Updated 2 years ago
• Yinan-Xia / PDF
  [ICML 2024] Official implementation for "Predictive Dynamic Fusion."
  ☆60Updated 7 months ago
• Duplums / CoMM
  [ICLR 2025] Multi-modal representation learning of shared, unique and synergistic features between modalities
  ☆37Updated 3 months ago
• YingWANGG / M2IB
  Code for the paper Visual Explanations of Image–Text Representations via Multi-Modal Information Bottleneck Attribution
  ☆55Updated last year
• yblir / GLIP_detection
  ☆12Updated last year
• muzairkhattak / multimodal-prompt-learning
  [CVPR 2023] Official repository of paper titled "MaPLe: Multi-modal Prompt Learning".
  ☆764Updated 2 years ago
• Mikael17125 / ViT-GradCAM
  ViT Grad-CAM Visualization
  ☆32Updated last year
• Chen-Yang-Liu / MLAT
  [IEEE GRSL 2022 🔥] "Remote Sensing Image Captioning Based on Multi-Layer Aggregated Transformer"
  ☆28Updated 2 years ago
• abhinav-neil / clip-zs-prompting
  Using CLIP for zero-shot learning and image classification with text & visual prompting.
  ☆15Updated 2 years ago