这是一个基于Pytorch平台、Transformer框架实现的视频描述生成 (Video Captioning) 深度学习模型。 视频描述生成任务指的是：输入一个视频，输出一句描述整个视频内容的文字（前提是视频较短且可以用一句话来描述）。本repo主要目的是帮助视力障碍者欣赏网络视频、感知周围环境，促进“无障碍视频”的发展。
☆100Mar 12, 2022Updated 4 years ago
Alternatives and similar repositories for Video-Captioning-Transformer
Users that are interested in Video-Captioning-Transformer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The first unofficial implementation of CLIP4Caption: CLIP for Video Caption (ACMMM 2021)☆16Jan 2, 2023Updated 3 years ago
- A PyTorch implementation of state of the art video captioning models from 2015-2019 on MSVD and MSRVTT datasets.☆73Jul 30, 2023Updated 3 years ago
- 视频的文本摘要(标注)，输入一段视频，通过深度学习网络和人工智能程序识别视频主要表达的意思(Input a video output a txt decribing the video)。☆189Mar 20, 2018Updated 8 years ago
- Video Captioning is an encoder decoder mode based on sequence to sequence learning☆138Apr 9, 2024Updated 2 years ago
- [ICLR 26] This repository contains the code and dataset for our paper: Language-guided Open-world Video Anomaly Detection under Weak Supe…☆30May 7, 2026Updated 3 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- The code of IJCAI22 paper "GL-RG: Global-Local Representation Granularity for Video Captioning".☆18May 10, 2023Updated 3 years ago
- (TIP'2023) Concept-Aware Video Captioning: Describing Videos with Effective Prior Information☆32Dec 26, 2024Updated last year
- The PyTorch code of the AAAI2021 paper "Non-Autoregressive Coarse-to-Fine Video Captioning".☆57Oct 22, 2023Updated 2 years ago
- This repository contains the code for a video captioning system inspired by Sequence to Sequence -- Video to Text. This system takes as i…☆170Oct 12, 2019Updated 6 years ago
- [CVPR2022] Official code for Hierarchical Modular Network for Video Captioning. Our proposed HMN is implemented with PyTorch.☆50Sep 30, 2022Updated 3 years ago
- pytorch implementation of video captioning☆400Aug 19, 2019Updated 6 years ago
- Source code for "Bi-modal Transformer for Dense Video Captioning" (BMVC 2020)☆231Apr 8, 2023Updated 3 years ago
- PyTorch implementation of Multi-modal Dense Video Captioning (CVPR 2020 Workshops)☆144Apr 8, 2023Updated 3 years ago
- Video Grounding and Captioning☆331Oct 12, 2021Updated 4 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Multi-model video-to-text by combining embeddings from Flan-T5 + CLIP + Whisper + SceneGraph. The 'backbone LLM' is pre-trained from scra…☆54Apr 21, 2023Updated 3 years ago
- Research code for CVPR 2022 paper "SwinBERT: End-to-End Transformers with Sparse Attention for Video Captioning"☆251May 26, 2022Updated 4 years ago
- Video to Text: Natural language description generator for some given video. [Video Captioning]☆363May 3, 2022Updated 4 years ago
- An official implementation for "CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval"☆1,030Apr 12, 2024Updated 2 years ago
- Pytorch implementation of audio-visual fusion video captioning model☆27Jul 26, 2018Updated 8 years ago
- 自动生成短视频，文章自动成片，多模态混剪，数字人，声音克隆☆13Jun 25, 2024Updated 2 years ago
- Extract video features from raw videos using multiple GPUs. We support RAFT flow frames as well as S3D, I3D, R(2+1)D, VGGish, CLIP, and T…☆656Feb 1, 2026Updated 6 months ago
- Video captioning baseline models on Video2Commonsense Dataset.☆56Apr 15, 2021Updated 5 years ago
- Unofficial Pytorch Implementation of UNet3Plus: A Full-Scale Connected UNet for Medical Image Segmentation☆15Jul 22, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A Pytorch implementation of "Reconstruction Network for Video Captioning", CVPR 2018☆53Apr 6, 2020Updated 6 years ago
- video captioning using 3DCNN and LSTM (pytorch)☆11Sep 26, 2019Updated 6 years ago
- ☆37Jan 20, 2023Updated 3 years ago
- ☆10Apr 20, 2018Updated 8 years ago
- ☆11Jul 11, 2023Updated 3 years ago
- Universal Video Temporal Grounding with Generative Multi-modal Large Language Models☆56May 20, 2026Updated 2 months ago
- (ACL'2023) MultiCapCLIP: Auto-Encoding Prompts for Zero-Shot Multilingual Visual Captioning☆36Aug 8, 2024Updated 2 years ago
- [ICPR 2024] Exemplar-free continual deepfake detector that leverages CLIP and domain-specific multi-modal prompts☆15Aug 1, 2024Updated 2 years ago
- ☆17Aug 6, 2021Updated 5 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- A Large-Scale Chinese Image-Text Benchmark for Real-World Short Video Search Scenarios☆13Jan 24, 2024Updated 2 years ago
- This program can encrypt secret messages using a combination of RC4 and base 64 cryptographic algorithms then insert them into image file…☆10Jan 22, 2020Updated 6 years ago
- This is an official implementation for "Not with my name! Inferring artists' names of input strings employed by Diffusion Models".☆15Aug 22, 2023Updated 2 years ago
- Extension of hLSTMat☆19Apr 15, 2021Updated 5 years ago
- An open source project on my CSDN blog, whose dataset is the CNN/DM and whose model is T5.☆12Jul 9, 2023Updated 3 years ago
- Simple High performance Infrastructure for Neural network Experiments☆14Sep 25, 2023Updated 2 years ago
- [ICCV 2023] Accurate and Fast Compressed Video Captioning☆52Jul 28, 2025Updated last year