Alternatives and similar repositories for grit:

Users that are interested in grit are comparing it to the libraries listed below

• GT-RIPL / Xmodal-Ctx
  Official PyTorch implementation of our CVPR 2022 paper: Beyond a Pre-Trained Object Detector: Cross-Modal Textual and Visual Context for …
  ☆60Updated 2 years ago
• zhangxuying1004 / RSTNet
  Official Code for 'RSTNet: Captioning with Adaptive Attention on Visual and Non-Visual Words' (CVPR 2021)
  ☆122Updated 2 years ago
• 232525 / PureT
  Implementation of 'End-to-End Transformer Based Model for Image Captioning' [AAAI 2022]
  ☆67Updated 8 months ago
• DavidHuji / CapDec
  CapDec: SOTA Zero Shot Image Captioning Using CLIP and GPT2, EMNLP 2022 (findings)
  ☆190Updated last year
• jianjieluo / OpenAI-CLIP-Feature
  An easy to use, user-friendly and efficient code for extracting OpenAI CLIP (Global/Grid) features from image and text respectively.
  ☆119Updated last month
• microsoft / SwinBERT
  Research code for CVPR 2022 paper "SwinBERT: End-to-End Transformers with Sparse Attention for Video Captioning"
  ☆239Updated 2 years ago
• jacobswan1 / ViTCAP
  Implementation for CVPR 2022 paper " Injecting Semantic Concepts into End-to-End Image Captionin".
  ☆42Updated 2 years ago
• xuguohai / X-CLIP
  An official implementation for "X-CLIP: End-to-End Multi-grained Contrastive Learning for Video-Text Retrieval"
  ☆149Updated 10 months ago
• buxiangzhiren / DDCap
  ☆84Updated 2 years ago
• mrwu-mac / DIFNet
  [CVPR 2022] This repository is for the paper ``DIFNet: Boosting Visual Information Flow for Image Captioning'' .
  ☆20Updated 2 years ago
• salesforce / ALPRO
  Align and Prompt: Video-and-Language Pre-training with Entity Prompts
  ☆187Updated 2 years ago
• jchenghu / ExpansionNet_v2
  Implementation code of the work "Exploiting Multiple Sequence Lengths in Fast End to End Training for Image Captioning"
  ☆86Updated last month
• foolwood / DRL
  [arXiv22] Disentangled Representation Learning for Text-Video Retrieval
  ☆94Updated 2 years ago
• SjokerLily / awesome-image-captioning
  A paper list of image captioning.
  ☆22Updated 2 years ago
• joeyz0z / ConZIC
  Official implementation of "ConZIC: Controllable Zero-shot Image Captioning by Sampling-Based Polishing"
  ☆74Updated last year
• pzzhang / VinVL
  project page for VinVL
  ☆351Updated last year
• terry-r123 / Awesome-Captioning
  A curated list of Multimodal Captioning related research(including image captioning, video captioning, and text captioning)
  ☆110Updated 2 years ago
• BryanPlummer / flickr30k_entities
  Flickr30K Entities Dataset
  ☆168Updated 6 years ago
• jianjieluo / SCD-Net
  [CVPR23] A cascaded diffusion captioning model with a novel semantic-conditional diffusion process that upgrades conventional diffusion m…
  ☆60Updated 8 months ago
• RoyalSkye / Image-Caption
  Using LSTM or Transformer to solve Image Captioning in Pytorch
  ☆76Updated 3 years ago
• RitaRamo / smallcap
  SmallCap: Lightweight Image Captioning Prompted with Retrieval Augmentation
  ☆102Updated last year
• showlab / all-in-one
  [CVPR2023] All in One: Exploring Unified Video-Language Pre-training
  ☆280Updated last year
• clip-vil / CLIP-ViL
  [ICLR 2022] code for "How Much Can CLIP Benefit Vision-and-Language Tasks?" https://arxiv.org/abs/2107.06383
  ☆410Updated 2 years ago
• dhg-wei / DeCap
  ICLR 2023 DeCap: Decoding CLIP Latents for Zero-shot Captioning
  ☆128Updated last year
• ttengwang / PDVC
  End-to-End Dense Video Captioning with Parallel Decoding (ICCV 2021)
  ☆213Updated last year
• layer6ai-labs / xpool
  https://layer6ai-labs.github.io/xpool/
  ☆118Updated last year
• rentainhe / TRAR-VQA
  [ICCV 2021] Official implementation of the paper "TRAR: Routing the Attention Spans in Transformers for Visual Question Answering"
  ☆66Updated 3 years ago
• jayleicn / singularity
  [ACL 2023] Official PyTorch code for Singularity model in "Revealing Single Frame Bias for Video-and-Language Learning"
  ☆132Updated last year
• luo3300612 / image-captioning-DLCT
  Official pytorch implementation of paper "Dual-Level Collaborative Transformer for Image Captioning" (AAAI 2021).
  ☆197Updated 2 years ago
• antoyang / just-ask
  [ICCV 2021 Oral + TPAMI] Just Ask: Learning to Answer Questions from Millions of Narrated Videos
  ☆118Updated last year