VideoAnalysis / EDUVSUM
EDUVSUM is a multimodal neural architecture that utilizes state-of-the-art audio, visual and textual features to identify important temporal segments in educational videos.
☆20Updated last year
Alternatives and similar repositories for EDUVSUM:
Users that are interested in EDUVSUM are comparing it to the libraries listed below
- Code and dataset of "MEmoR: A Dataset for Multimodal Emotion Reasoning in Videos" in MM'20.☆53Updated last year
- Code for the AVLnet (Interspeech 2021) and Cascaded Multilingual (Interspeech 2021) papers.☆50Updated 3 years ago
- PyTorch implementation of Multi-modal Dense Video Captioning (CVPR 2020 Workshops)☆144Updated last year
- Implementation of the Benchmark Approaches for Medical Instructional Video Classification (MedVidCL) and Medical Video Question Answering…☆28Updated 2 years ago
- ☆16Updated 4 years ago
- Humor Knowledge Enriched Transformer☆30Updated 3 years ago
- PyTorch Implementation on Paper [CVPR2021]Distilling Audio-Visual Knowledge by Compositional Contrastive Learning☆86Updated 3 years ago
- Multimodal short video classification task, integrating video, image, audio and text modes for short video classification☆19Updated 5 years ago
- EACL 2023 paper "MLASK: Multimodal Summarization of Video-based News Articles"☆10Updated last year
- Video Feature Extractor for S3D-HowTo100M☆29Updated 3 years ago
- [CVPR 2024] MMSum: A Dataset for Multimodal Summarization and Thumbnail Generation of Videos☆31Updated 2 months ago
- ☆31Updated 2 years ago
- Learning Interactions and Relationships between Movie Characters (CVPR'20)☆21Updated last year
- Implementation of "Audio Retrieval with Natural Language Queries", INTERSPEECH 2021, PyTorch☆27Updated last year
- Use CLIP to represent video for Retrieval Task☆69Updated 4 years ago
- Code for paper, "TL;DW? Summarizing Instructional Videos with Task Relevance & Cross-Modal Saliency" ECCV 2022☆38Updated 2 years ago
- Deep learning model for supervised video summarization called Multi Source Visual Attention (MSVA)☆44Updated last year
- Re-implementation of the work Livebot☆15Updated 4 years ago
- Code on selecting an action based on multimodal inputs. Here in this case inputs are voice and text.☆71Updated 3 years ago
- Code and pre-trained models for my submission to the ChaLearn 2021 LAP challenge.☆18Updated 2 years ago
- [ECCV 2020] PyTorch code of MMT (a multimodal transformer captioning model) on TVCaption dataset☆90Updated last year
- [ICCV 2021 Oral + TPAMI] Just Ask: Learning to Answer Questions from Millions of Narrated Videos☆120Updated last year
- ☆22Updated last year
- Identity-Aware Multi-Sentence Video Description☆15Updated last year
- A PyTorch Implementation of CA-SUM from "Summarizing Videos using Concentrated Attention and Considering the Uniqueness and Diversity of …☆29Updated 2 years ago
- Audio Visual Scene-Aware Dialog (AVSD) Challenge at the 10th Dialog System Technology Challenge (DSTC)☆27Updated 2 years ago
- [NeurIPS 2022] PointTAD: Multi-Label Temporal Action Detection with Learnable Query Points☆44Updated last year
- [ICCV 2023] Accurate and Fast Compressed Video Captioning☆40Updated last year
- A Video Summarization framework for implementation and benchmark of Deep Learning models☆34Updated 6 months ago
- ☆243Updated 2 years ago