e-apostolidis / XAI-SUMLinks
A PyTorch implementation of the software used in: "A study on the use of attention for explaining video summarization" (NarSUM Workshop at ACM MM 2023) and "Explaining video summarization based on the focus of attention" (IEEE ISM 2022)
☆11Updated 2 years ago
Alternatives and similar repositories for XAI-SUM
Users that are interested in XAI-SUM are comparing it to the libraries listed below
Sorting:
- A PyTorch Implementation of CA-SUM from "Summarizing Videos using Concentrated Attention and Considering the Uniqueness and Diversity of …☆31Updated 3 years ago
- A PyTorch Implementation of PGL-SUM from "Combining Global and Local Attention with Positional Encoding for Video Summarization" (IEEE IS…☆91Updated 2 years ago
- Deep learning model for supervised video summarization called Multi Source Visual Attention (MSVA)☆46Updated last year
- Code for paper, "TL;DW? Summarizing Instructional Videos with Task Relevance & Cross-Modal Saliency" ECCV 2022☆39Updated 2 years ago
- Source code for the paper "Unsupervised Video Summarization via Multi-source Features" published at ICMR 2021☆21Updated 3 years ago
- Pytorch code for paper Contrastive Losses Are Natural Criteria for Unsupervised Video Summarization☆21Updated 2 years ago
- A PyTorch Implementation of AC-SUM-GAN from "AC-SUM-GAN: Connecting Actor-Critic and Generative Adversarial Networks for Unsupervised Vid…☆29Updated 3 years ago
- UMT is a unified and flexible framework which can handle different input modality combinations, and output video moment retrieval and/or …☆231Updated last year
- Video Summarization With Spatiotemporal Vision Transformer☆22Updated 2 years ago
- [NeurIPS 2021] Moment-DETR code and QVHighlights dataset☆331Updated last year
- https://layer6ai-labs.github.io/xpool/☆129Updated 2 years ago
- Pytorch implementation for "Progressive Video Summarization via Multimodal Self-supervised Learning"☆35Updated 2 months ago
- The official implementation of 'Align and Attend: Multimodal Summarization with Dual Contrastive Losses' (CVPR 2023)☆79Updated 2 years ago
- [arXiv22] Disentangled Representation Learning for Text-Video Retrieval☆97Updated 3 years ago
- [CVPR2022] Official code for Hierarchical Modular Network for Video Captioning. Our proposed HMN is implemented with PyTorch.☆50Updated 3 years ago
- Pytorch implementation of DSR-RL for Video Summarization Task☆12Updated 4 years ago
- Video Feature Extraction Code for EMNLP 2020 paper "HERO: Hierarchical Encoder for Video+Language Omni-representation Pre-training"☆115Updated 4 years ago
- Official pytorch repository for "QD-DETR : Query-Dependent Video Representation for Moment Retrieval and Highlight Detection" (CVPR 2023 …☆242Updated 3 months ago
- A python implementation for computing the PoR metric for video summarization from "Performance over Random: A Robust Evaluation Protocol …☆10Updated 3 years ago
- Official code for "Bridging Video-text Retrieval with Multiple Choice Questions", CVPR 2022 (Oral).☆141Updated 3 years ago
- A PyTorch implementation of state of the art video captioning models from 2015-2019 on MSVD and MSRVTT datasets.☆73Updated 2 years ago
- Research code for CVPR 2022 paper "SwinBERT: End-to-End Transformers with Sparse Attention for Video Captioning"