joeljose / Visual-Mic
When sound hits an object, it causes small vibrations on the object’s surface. Here we show how, using only high-speed video of the object, we can extract those minute vibrations and partially recover the sound that produced them, allowing us to turn everyday objects—a glass of water, a potted plant, a box of tissues, or a bag of chips—into visu…
☆11Updated 2 months ago
Related projects ⓘ
Alternatives and complementary repositories for Visual-Mic
- Deep neural network trained to detect eye contact from facial image☆89Updated 3 months ago
- This repository implements T. Oh, R. Jaroensri, C. Kim, M. Elgharib, F. Durand, W. Freeman, W. Matusik "Learning-based Video Motion Magni…☆35Updated 4 years ago
- An unofficial implementation of "Learning-based Video Motion Magnification" in Pytorch.☆103Updated 7 months ago
- Speech to Facial Animation using GANs☆41Updated 3 years ago
- Implementation of Phase-Based Video Motion Processing (Wadhwa et al. 2013)☆28Updated 4 years ago
- Passive Recovery of Sound from Video☆40Updated 4 years ago
- Gaze tracking☆55Updated 8 months ago
- A modified version of vid2vid for Speech2Video, Text2Video Paper☆35Updated last year
- This github contains the network architectures of NeuralVoicePuppetry.☆78Updated 3 years ago
- A large-scale publicly-available visual-thermal-audio dataset designed to encourage research in the general areas of user authentication,…☆78Updated 3 years ago
- Real-time Python demos of google mediapipe☆128Updated 2 years ago
- Audio-driven facial animation generator with BiLSTM used for transcribing the speech and web interface displaying the avatar and the anim…☆34Updated 2 years ago
- The code for the paper "Speech Driven Talking Face Generation from a Single Image and an Emotion Condition"☆166Updated last year
- Iris tracking MediaPipe Video Tutorial Source code☆36Updated 2 years ago
- ☆35Updated last year
- Gaze + IMU Gestures on Mobile Devices☆60Updated 2 years ago
- CVPR 2022: Cross-Modal Perceptionist: Can Face Geometry be Gleaned from Voices?☆126Updated last year
- STB-VMM: Swin Transformer Based Video Motion Magnification (official repository)☆36Updated last year
- SMPLpix: Neural Avatars from 3D Human Models☆425Updated 3 months ago
- Challenges in Video-Based Infant Action Recognition: A Critical Examination of the State of the Art (WACVW'24)☆12Updated last year
- Collections of papers, databases, and codes targeted at Digital Human☆29Updated 8 months ago
- ☆96Updated 9 months ago
- This project utilizes machine learning algorithms to find the direction in which a person is looking by using the face landmarks☆45Updated 2 years ago
- Source code for: Expressive Speech-driven Facial Animation with controllable emotions☆34Updated 10 months ago
- ☆99Updated 10 months ago
- PyTorch implementation for NED (CVPR 2022). It can be used to manipulate the facial emotions of actors in videos based on emotion labels …☆157Updated 2 years ago
- ☆18Updated 7 years ago
- ☆39Updated last year
- Blender add-on to implement VOCA neural network.☆58Updated 2 years ago
- Facial Expression Analysis Toolbox☆261Updated last month