这是一个基于Pytorch平台、Transformer框架实现的视频描述生成 (Video Captioning) 深度学习模型。 视频描述生成任务指的是:输入一个视频,输出一句描述整个视频内容的文字(前提是视频较短且可以用一句话来描述)。本repo主要目的是帮助视力障碍者欣赏网络视频、感知周围环境,促进“无障碍视频”的发展。
☆102Mar 12, 2022Updated 4 years ago
Alternatives and similar repositories for Video-Captioning-Transformer
Users that are interested in Video-Captioning-Transformer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The first unofficial implementation of CLIP4Caption: CLIP for Video Caption (ACMMM 2021)☆16Jan 2, 2023Updated 3 years ago
- A PyTorch implementation of state of the art video captioning models from 2015-2019 on MSVD and MSRVTT datasets.☆74Jul 30, 2023Updated 2 years ago
- Video Captioning is an encoder decoder mode based on sequence to sequence learning☆141Apr 9, 2024Updated last year
- The code of IJCAI22 paper "GL-RG: Global-Local Representation Granularity for Video Captioning".☆18May 10, 2023Updated 2 years ago
- (TIP'2023) Concept-Aware Video Captioning: Describing Videos with Effective Prior Information☆32Dec 26, 2024Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- This repository contains the code for a video captioning system inspired by Sequence to Sequence -- Video to Text. This system takes as i…☆172Oct 12, 2019Updated 6 years ago
- The implementation of a paper entitled "Action Knowledge for Video Captioning with Graph Neural Networks" (JKSUCIS 2023).☆14Mar 29, 2023Updated 2 years ago
- [CVPR2022] Official code for Hierarchical Modular Network for Video Captioning. Our proposed HMN is implemented with PyTorch.☆50Sep 30, 2022Updated 3 years ago
- pytorch implementation of video captioning☆400Aug 19, 2019Updated 6 years ago
- Official pytorch implementation of the AAAI 2021 paper "Semantic Grouping Network for Video Captioning"☆54Jul 9, 2021Updated 4 years ago
- Video Grounding and Captioning☆332Oct 12, 2021Updated 4 years ago
- PyTorch implementation of Multi-modal Dense Video Captioning (CVPR 2020 Workshops)☆144Apr 8, 2023Updated 2 years ago
- Video to Text: Natural language description generator for some given video. [Video Captioning]☆359May 3, 2022Updated 3 years ago
- An official implementation for "CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval"☆1,026Apr 12, 2024Updated last year
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Pytorch implementation of audio-visual fusion video captioning model☆27Jul 26, 2018Updated 7 years ago
- 自动生成短视频,文章自动成片,多模态混剪,数字人,声音克隆☆13Jun 25, 2024Updated last year
- Extract video features from raw videos using multiple GPUs. We support RAFT flow frames as well as S3D, I3D, R(2+1)D, VGGish, CLIP, and T…☆651Feb 1, 2026Updated last month
- A Pytorch implementation of "Reconstruction Network for Video Captioning", CVPR 2018☆53Apr 6, 2020Updated 5 years ago
- Video captioning baseline models on Video2Commonsense Dataset.☆56Apr 15, 2021Updated 4 years ago
- 【CVPR'2023 Highlight & TPAMI】Cap4Video: What Can Auxiliary Captions Do for Text-Video Retrieval?☆258Nov 29, 2024Updated last year
- This repo holds the code for our 3DV 2021 paper "Fusing Posture and Position Representations for Point Cloud-Based Hand Gesture Recogniti…☆13Apr 26, 2022Updated 3 years ago
- video captioning using 3DCNN and LSTM (pytorch)☆11Sep 26, 2019Updated 6 years ago
- ☆38Jan 20, 2023Updated 3 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆10Apr 20, 2018Updated 7 years ago
- Unofficial Pytorch Implementation of UNet3Plus: A Full-Scale Connected UNet for Medical Image Segmentation☆15Jul 22, 2024Updated last year
- ☆11Jul 11, 2023Updated 2 years ago
- [ECCV 2024] LaPose: Laplacian Mixture Shape Modeling for RGB-Based Category-Level Object Pose Estimation☆15Dec 23, 2024Updated last year
- Summary about Video-to-Text datasets. This repository is part of the review paper *Bridging Vision and Language from the Video-to-Text Pe…☆133Oct 27, 2023Updated 2 years ago
- (ACL'2023) MultiCapCLIP: Auto-Encoding Prompts for Zero-Shot Multilingual Visual Captioning☆36Aug 8, 2024Updated last year
- 自己使用Request+PyQT编写可视化视频解析工具,主要借用全民解析API的进行的各源头VIP视频解析,软件主要有各大厂的视频VIP解析功能,主要通过网络爬虫解析 视频源,实现点击线路即可自动加载浏览器播放视频的功能,还有在加载视频的同时也生成对应的链接二维码,微信扫一扫…☆24Jun 2, 2020Updated 5 years ago
- ☆17Aug 6, 2021Updated 4 years ago
- An open source project on my CSDN blog, whose dataset is the CNN/DM and whose model is T5.☆12Jul 9, 2023Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- [ICCV 2023] Accurate and Fast Compressed Video Captioning☆52Jul 28, 2025Updated 8 months ago
- An official implementation for " UniVL: A Unified Video and Language Pre-Training Model for Multimodal Understanding and Generation"☆365Jul 25, 2024Updated last year
- Hide text informations using invisible text characters☆12Apr 4, 2022Updated 3 years ago
- A pytorch implementation of our paper Image Captioning with Inherent Sentiment (ICME 2021 Oral).☆11Jul 18, 2022Updated 3 years ago
- Patch-Diffusion Code (AAAI2022)☆13Mar 3, 2022Updated 4 years ago
- GNURadio block to play back files with delays between replays and/or limited replay counts.☆15Sep 16, 2023Updated 2 years ago
- Official repository for "Unveiling Opinion Evolution via Prompting and Diffusion for Short Video Fake News Detection", ACL Findings 2024.☆15Apr 25, 2025Updated 11 months ago