Alternatives and similar repositories for grit:

Users that are interested in grit are comparing it to the libraries listed below

• GT-RIPL / Xmodal-Ctx
  Official PyTorch implementation of our CVPR 2022 paper: Beyond a Pre-Trained Object Detector: Cross-Modal Textual and Visual Context for …
  ☆60Updated 2 years ago
• 232525 / PureT
  Implementation of 'End-to-End Transformer Based Model for Image Captioning' [AAAI 2022]
  ☆67Updated 11 months ago
• jacobswan1 / ViTCAP
  Implementation for CVPR 2022 paper " Injecting Semantic Concepts into End-to-End Image Captionin".
  ☆43Updated 2 years ago
• zhangxuying1004 / RSTNet
  Official Code for 'RSTNet: Captioning with Adaptive Attention on Visual and Non-Visual Words' (CVPR 2021)
  ☆122Updated 2 years ago
• DavidHuji / CapDec
  CapDec: SOTA Zero Shot Image Captioning Using CLIP and GPT2, EMNLP 2022 (findings)
  ☆196Updated last year
• Yushi-Hu / PromptCap
  natual language guided image captioning
  ☆82Updated last year
• pzzhang / VinVL
  project page for VinVL
  ☆354Updated last year
• SjokerLily / awesome-image-captioning
  A paper list of image captioning.
  ☆22Updated 3 years ago
• joeyz0z / ConZIC
  Official implementation of "ConZIC: Controllable Zero-shot Image Captioning by Sampling-Based Polishing"
  ☆73Updated last year
• showlab / all-in-one
  [CVPR2023] All in One: Exploring Unified Video-Language Pre-training
  ☆282Updated 2 years ago
• xuguohai / X-CLIP
  An official implementation for "X-CLIP: End-to-End Multi-grained Contrastive Learning for Video-Text Retrieval"
  ☆157Updated last year
• jianjieluo / OpenAI-CLIP-Feature
  An easy to use, user-friendly and efficient code for extracting OpenAI CLIP (Global/Grid) features from image and text respectively.
  ☆126Updated 4 months ago
• dhg-wei / DeCap
  ICLR 2023 DeCap: Decoding CLIP Latents for Zero-shot Captioning
  ☆133Updated 2 years ago
• jchenghu / ExpansionNet_v2
  Implementation code of the work "Exploiting Multiple Sequence Lengths in Fast End to End Training for Image Captioning"
  ☆91Updated 4 months ago
• sail-sg / ptp
  [CVPR2023] The code for 《Position-guided Text Prompt for Vision-Language Pre-training》
  ☆152Updated last year
• microsoft / SwinBERT
  Research code for CVPR 2022 paper "SwinBERT: End-to-End Transformers with Sparse Attention for Video Captioning"
  ☆237Updated 2 years ago
• clip-vil / CLIP-ViL
  [ICLR 2022] code for "How Much Can CLIP Benefit Vision-and-Language Tasks?" https://arxiv.org/abs/2107.06383
  ☆411Updated 2 years ago
• terry-r123 / Awesome-Captioning
  A curated list of Multimodal Captioning related research(including image captioning, video captioning, and text captioning)
  ☆110Updated 2 years ago
• RitaRamo / smallcap
  SmallCap: Lightweight Image Captioning Prompted with Retrieval Augmentation
  ☆107Updated last year
• salesforce / ALPRO
  Align and Prompt: Video-and-Language Pre-training with Entity Prompts
  ☆187Updated this week
• BryanPlummer / flickr30k_entities
  Flickr30K Entities Dataset
  ☆172Updated 6 years ago
• mrwu-mac / DIFNet
  [CVPR 2022] This repository is for the paper ``DIFNet: Boosting Visual Information Flow for Image Captioning'' .
  ☆20Updated 2 years ago
• ylsung / VL_adapter
  PyTorch code for "VL-Adapter: Parameter-Efficient Transfer Learning for Vision-and-Language Tasks" (CVPR2022)
  ☆206Updated 2 years ago
• buxiangzhiren / DDCap
  ☆84Updated 2 years ago
• allenai / reclip
  ☆83Updated 3 years ago
• jianjieluo / SCD-Net
  [CVPR23] A cascaded diffusion captioning model with a novel semantic-conditional diffusion process that upgrades conventional diffusion m…
  ☆61Updated 10 months ago
• YulongBonjour / SimVLM
  SimVLM ---SIMPLE VISUAL LANGUAGE MODEL PRETRAINING WITH WEAK SUPERVISION
  ☆36Updated 2 years ago
• ttengwang / PDVC
  End-to-End Dense Video Captioning with Parallel Decoding (ICCV 2021)
  ☆219Updated last year
• amazon-science / mix-generation
  MixGen: A New Multi-Modal Data Augmentation
  ☆122Updated 2 years ago
• rentainhe / TRAR-VQA
  [ICCV 2021] Official implementation of the paper "TRAR: Routing the Attention Spans in Transformers for Visual Question Answering"
  ☆66Updated 3 years ago