jingliao132 / CrossModalRetrieval
Pytorch implementation of 'See, Hear, and Read: Deep Aligned Representations'
☆33Updated 6 years ago
Alternatives and similar repositories for CrossModalRetrieval:
Users that are interested in CrossModalRetrieval are comparing it to the libraries listed below
- Learning to Separate Object Sounds by Watching Unlabeled Video (ECCV 2018)☆49Updated 5 years ago
- Audio-Visual Event Localization in Unconstrained Videos, ECCV 2018☆181Updated 4 years ago
- Listen to Look: Action Recognition by Previewing Audio (CVPR 2020)☆129Updated 3 years ago
- Code for Discriminative Sounding Objects Localization (NeurIPS 2020)☆57Updated 3 years ago
- Self-Supervised Learning by Cross-Modal Audio-Video Clustering (NeurIPS 2020)☆90Updated 2 years ago
- [2021 CVPR] Positive Sample Propagation along the Audio-Visual Event Line☆41Updated 2 years ago
- Joint Embedding with Multimodal Cues for Cross-Modal Video-Text Retrieval☆67Updated 5 years ago
- Code for CVPR 2021 paper Exploring Heterogeneous Clues for Weakly-Supervised Audio-Visual Video Parsing☆24Updated 3 years ago
- Cross-Modal Interaction Networks for Query-Based Moment Retrieval in Videos☆86Updated 4 years ago
- Heterogeneous Memory Enhanced Multimodal Attention Model for VideoQA☆54Updated 3 years ago
- Multimodal Adversarial Network for Cross-modal Retrieval (PyTorch Code)☆30Updated 5 years ago
- PyTorch Implementation on Paper [CVPR2021]Distilling Audio-Visual Knowledge by Compositional Contrastive Learning☆87Updated 3 years ago
- Code for the AVLnet (Interspeech 2021) and Cascaded Multilingual (Interspeech 2021) papers.☆51Updated 3 years ago
- Polysemous Visual-Semantic Embedding for Cross-Modal Retrieval (CVPR 2019)☆134Updated last year
- Implementation of "EPIC-Fusion: Audio-Visual Temporal Binding for Egocentric Action Recognition, ICCV, 2019" in PyTorch☆111Updated 4 years ago
- ACM ICMR 2019《Cross-Modal Video Moment Retrieval with Spatial and Language-Temporal Attention》☆36Updated 5 years ago
- Keras Implementation of "Look, Listen and Learn" Model☆21Updated 7 years ago
- Unofficial Implementation of Google Deepmind's paper `Objects that Sound`☆83Updated 6 years ago
- Deep Audio-Visual Embedding network (DAVEnet) implementation in PyTorch☆65Updated 6 years ago
- Implementation for ECCV20 paper "Self-Supervised Learning of audio-visual objects from video"☆113Updated 4 years ago
- Extension of hLSTMat☆18Updated 4 years ago
- Official implementation of ACMMM'20 paper 'Self-supervised Video Representation Learning Using Inter-intra Contrastive Framework'☆111Updated 4 years ago
- Official Tensorflow Implementation of the AAAI-2020 paper "Temporally Grounding Language Queries in Videos by Contextual Boundary-aware P…☆60Updated 2 years ago
- ☆90Updated 3 years ago
- Extract video feature from C3D pretrained on Sports-1M and Kinetics☆15Updated 5 years ago
- Released code and data for "Frame-Transformer Emotion Classification Network." ICMR 2017☆18Updated 7 years ago
- Generalized cross-modal NNs; new audiovisual benchmark (IEEE TNNLS 2019)☆26Updated 5 years ago
- Beyond RNNs: Positional Self-Attention with Co-Attention for Video Question Answering☆27Updated 4 years ago
- The implementation of Sequential VLAD in Pytorch☆19Updated 5 years ago
- Audio Visual Instance Discrimination with Cross-Modal Agreement☆128Updated 3 years ago