Kamino666 / Video-Captioning-TransformerLinks
这是一个基于Pytorch平台、Transformer框架实现的视频描述生成 (Video Captioning) 深度学习模型。  视频描述生成任务指的是:输入一个视频,输出一句描述整个视频内容的文字(前提是视频较短且可以用一句话来描述)。本repo主要目的是帮助视力障碍者欣赏网络视频、 感知周围环境,促进“无障碍视频”的发展。
☆96Updated 3 years ago
Alternatives and similar repositories for Video-Captioning-Transformer
Users that are interested in Video-Captioning-Transformer are comparing it to the libraries listed below
Sorting:
- 前沿论文持续更新--视频时刻定位 or 时域语言定位 or 视频片段检索。☆257Updated 2 years ago
 - An official implementation for "CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval"☆997Updated last year
 - 基于ClipCap的看图说话Image Caption模型☆316Updated 3 years ago
 - End-to-End Dense Video Captioning with Parallel Decoding (ICCV 2021)☆224Updated last year
 - Research code for CVPR 2022 paper "SwinBERT: End-to-End Transformers with Sparse Attention for Video Captioning"☆245Updated 3 years ago
 - [CVPR2022] Official code for Hierarchical Modular Network for Video Captioning. Our proposed HMN is implemented with PyTorch.☆50Updated 3 years ago
 - A PyTorch implementation of state of the art video captioning models from 2015-2019 on MSVD and MSRVTT datasets.☆73Updated 2 years ago
 - ☆254Updated 2 years ago
 - UMT is a unified and flexible framework which can handle different input modality combinations, and output video moment retrieval and/or …☆230Updated last year
 - ☆16Updated last year
 - The datasets for image emotion computing☆37Updated 3 years ago
 - An official implementation for " UniVL: A Unified Video and Language Pre-Training Model for Multimodal Understanding and Generation"☆362Updated last year
 - The implementation of a paper entitled "Action Knowledge for Video Captioning with Graph Neural Networks" (JKSUCIS 2023).☆13Updated 2 years ago
 - [arXiv22] Disentangled Representation Learning for Text-Video Retrieval☆97Updated 3 years ago
 - The first unofficial implementation of CLIP4Caption: CLIP for Video Caption (ACMMM 2021)☆15Updated 2 years ago
 - (TIP'2023) Concept-Aware Video Captioning: Describing Videos with Effective Prior Information☆30Updated 10 months ago
 - This is the official implement of paper "ActionCLIP: A New Paradigm for Action Recognition"☆588Updated last year
 - Using VideoBERT to tackle video prediction☆132Updated 4 years ago
 - https://layer6ai-labs.github.io/xpool/☆129Updated 2 years ago
 - Implementation of 'End-to-End Transformer Based Model for Image Captioning' [AAAI 2022]☆69Updated last year
 - 多模态视频分类模型☆24Updated 2 years ago
 - 毕业设计:《基于CLIP模型的视频文本检索设计与实现》☆14Updated last year
 - The PyTorch code of the AAAI2021 paper "Non-Autoregressive Coarse-to-Fine Video Captioning".☆58Updated 2 years ago
 - [TPAMI2024] Codes and Models for VALOR: Vision-Audio-Language Omni-Perception Pretraining Model and Dataset☆305Updated 10 months ago
 - [NeurIPS 2021] Moment-DETR code and QVHighlights dataset☆328Updated last year
 - A curated list of deep learning resources for video-text retrieval.☆633Updated 2 years ago
 - PyTorch implementation of Multi-modal Dense Video Captioning (CVPR 2020 Workshops)☆143Updated 2 years ago
 - Extract video features from raw videos using multiple GPUs. We support RAFT flow frames as well as S3D, I3D, R(2+1)D, VGGish, CLIP, and T…☆624Updated 9 months ago
 - Official pytorch repository for "QD-DETR : Query-Dependent Video Representation for Moment Retrieval and Highlight Detection" (CVPR 2023 …☆240Updated 2 months ago
 - [AAAI2021] The code of “Similarity Reasoning and Filtration for Image-Text Matching”☆219Updated last year