Kamino666 / Video-Captioning-Transformer
这是一个基于Pytorch平台、Transformer框架实现的视频描述生成 (Video Captioning) 深度学习模型。 视频描述生成任务指的是：输入一个视频，输出一句描述整个视频内容的文字（前提是视频较短且可以用一句话来描述）。本repo主要目的是帮助视力障碍者欣赏网络视频、感知周围环境，促进“无障碍视频”的发展。
☆79Updated 2 years ago
Related projects ⓘ
Alternatives and complementary repositories for Video-Captioning-Transformer
- 前沿论文持续更新--视频时刻定位 or 时域语言定位 or 视频片段检索。☆236Updated last year
- Research code for CVPR 2022 paper "SwinBERT: End-to-End Transformers with Sparse Attention for Video Captioning"☆237Updated 2 years ago
- End-to-End Dense Video Captioning with Parallel Decoding (ICCV 2021)☆208Updated 10 months ago
- [CVPR2022] Official code for Hierarchical Modular Network for Video Captioning. Our proposed HMN is implemented with PyTorch.☆52Updated 2 years ago
- (TIP'2023) Concept-Aware Video Captioning: Describing Videos with Effective Prior Information☆24Updated 3 months ago
- A PyTorch implementation of state of the art video captioning models from 2015-2019 on MSVD and MSRVTT datasets.☆70Updated last year
- ☆231Updated last year
- ☆14Updated 4 months ago
- PyTorch implementation of Multi-modal Dense Video Captioning (CVPR 2020 Workshops)☆143Updated last year
- Implementation of 'End-to-End Transformer Based Model for Image Captioning' [AAAI 2022]☆67Updated 5 months ago
- 基于ClipCap的看图说话Image Caption模型☆285Updated 2 years ago
- Official pytorch implementation of the AAAI 2021 paper "Semantic Grouping Network for Video Captioning"☆52Updated 3 years ago
- https://layer6ai-labs.github.io/xpool/☆116Updated last year
- [arXiv22] Disentangled Representation Learning for Text-Video Retrieval☆92Updated 2 years ago
- The PyTorch code of the AAAI2021 paper "Non-Autoregressive Coarse-to-Fine Video Captioning".☆58Updated last year
- Temporal Moment(Action) Localization via Language / Temporal Language Grounding / Video Moment Retrieval☆94Updated 2 years ago
- UMT is a unified and flexible framework which can handle different input modality combinations, and output video moment retrieval and/or …☆193Updated 7 months ago
- Using VideoBERT to tackle video prediction☆117Updated 3 years ago
- 视频的文本摘要(标注)，输入一段视频，通过深度学习网络和人工智能程序识别视频主要表达的意思(Input a video output a txt decribing the video)。☆179Updated 6 years ago
- Code accompanying the paper "Fine-grained Video-Text Retrieval with Hierarchical Graph Reasoning".☆209Updated 4 years ago
- The first unofficial implementation of CLIP4Caption: CLIP for Video Caption (ACMMM 2021)☆14Updated last year
- [NeurIPS 2022 Spotlight] Expectation-Maximization Contrastive Learning for Compact Video-and-Language Representations☆121Updated 7 months ago
- The implementation of a paper entitled "Action Knowledge for Video Captioning with Graph Neural Networks" (JKSUCIS 2023).☆13Updated last year
- This is the official implement of paper "ActionCLIP: A New Paradigm for Action Recognition"☆517Updated 11 months ago
- ☆12Updated 6 months ago
- An official implementation for " UniVL: A Unified Video and Language Pre-Training Model for Multimodal Understanding and Generation"☆338Updated 3 months ago
- Pytorch Code for "Unified Coarse-to-Fine Alignment for Video-Text Retrieval" (ICCV 2023)☆61Updated 5 months ago
- A curated list of Multimodal Captioning related research(including image captioning, video captioning, and text captioning)☆108Updated 2 years ago
- Source code for "Bi-modal Transformer for Dense Video Captioning" (BMVC 2020)☆226Updated last year