facebookresearch / selavi
This repo covers the implementation for Labelling unlabelled videos from scratch with multi-modal self-supervision, which learns clusters from multi-modal data in a self-supervised way.
☆115Updated 3 years ago
Related projects ⓘ
Alternatives and complementary repositories for selavi
- Audio Visual Instance Discrimination with Cross-Modal Agreement☆127Updated 3 years ago
- [ECCV'20 Spotlight] Memory-augmented Dense Predictive Coding for Video Representation Learning. Tengda Han, Weidi Xie, Andrew Zisserman.☆164Updated 3 years ago
- Self-Supervised Learning by Cross-Modal Audio-Video Clustering (NeurIPS 2020)☆90Updated 2 years ago
- Video Representation Learning by Dense Predictive Coding. Tengda Han, Weidi Xie, Andrew Zisserman.☆251Updated 3 years ago
- Datasets, transforms and samplers for video in PyTorch☆86Updated last year
- ☆86Updated 2 years ago
- code for our ECCV-2020 paper: Self-supervised Video Representation Learning by Pace Prediction☆99Updated 3 years ago
- PyTorch GPU distributed training code for MIL-NCE HowTo100M☆214Updated 2 years ago
- [NeurIPS'20] Self-supervised Co-Training for Video Representation Learning. Tengda Han, Weidi Xie, Andrew Zisserman.☆287Updated 3 years ago
- Official implementation of ACMMM'20 paper 'Self-supervised Video Representation Learning Using Inter-intra Contrastive Framework'☆110Updated 3 years ago
- Video Noise Contrastive Estimation☆65Updated last year
- We present a framework for training multi-modal deep learning models on unlabelled video data by forcing the network to learn invariances…☆45Updated 3 years ago
- Listen to Look: Action Recognition by Previewing Audio (CVPR 2020)☆127Updated 3 years ago
- Video Representation Learning by Recognizing Temporal Transformations. In ECCV, 2020.☆48Updated 3 years ago
- Self-supervised Spatiotemporal Learning via Video Clip Order Prediction☆102Updated last year
- ☆88Updated 4 years ago
- Code for Learning to Learn Language from Narrated Video☆33Updated last year
- A ShuffleBatchNorm layer to shuffle BatchNorm statistics across multiple GPUs☆56Updated 2 years ago
- RareAct: A video dataset of unusual interactions☆32Updated 4 years ago
- Video Contrastive Learning with Global Context, ICCVW 2021☆158Updated 2 years ago
- ActorObserverNet code in PyTorch from "Actor and Observer: Joint Modeling of First and Third-Person Videos", CVPR 2018☆76Updated 5 years ago
- The Holistic Video Understanding Dataset (ECCV 2020 Spotlight presentation)☆70Updated 3 years ago
- ☆63Updated 3 years ago
- ☆74Updated 2 years ago
- Unsupervised learning of action classes with continuous temporal embedding (CVPR'19)☆66Updated 4 years ago
- Implementation for ECCV20 paper "Self-Supervised Learning of audio-visual objects from video"☆111Updated 4 years ago
- Implementation of "EPIC-Fusion: Audio-Visual Temporal Binding for Egocentric Action Recognition, ICCV, 2019" in PyTorch☆108Updated 3 years ago
- A Dataset for Grounded Video Description☆159Updated 2 years ago
- CATER: A diagnostic dataset for Compositional Actions and TEmporal Reasoning☆103Updated 3 years ago
- Attribute-Object Visual Composition using Attributes as Operators☆64Updated last year