joeljose / Visual-Mic
When sound hits an object, it causes small vibrations on the object’s surface. Here we show how, using only high-speed video of the object, we can extract those minute vibrations and partially recover the sound that produced them, allowing us to turn everyday objects—a glass of water, a potted plant, a box of tissues, or a bag of chips—into visu…
☆11Updated 5 months ago
Alternatives and similar repositories for Visual-Mic:
Users that are interested in Visual-Mic are comparing it to the libraries listed below
- Passive Recovery of Sound from Video☆41Updated 4 years ago
- This repository implements T. Oh, R. Jaroensri, C. Kim, M. Elgharib, F. Durand, W. Freeman, W. Matusik "Learning-based Video Motion Magni…☆39Updated 5 years ago
- ☆40Updated last year
- Real-Time Lip Sync for Live 2D Animation☆134Updated 5 years ago
- Real-time Python demos of google mediapipe☆130Updated 2 years ago
- Audio-driven facial animation generator with BiLSTM used for transcribing the speech and web interface displaying the avatar and the anim…☆35Updated 2 years ago
- Speech to Facial Animation using GANs☆41Updated 3 years ago
- PyTorch implementation of NEUTART, a system that creates photorealistic talking avatars from an input text transcription.☆33Updated 11 months ago
- ☆21Updated 2 years ago
- Audio driven video synthesis☆41Updated 2 years ago
- Iris tracking MediaPipe Video Tutorial Source code☆39Updated 3 years ago
- Code for Pose-Controllable Talking Face Generation by Implicitly Modularized Audio-Visual Representation (CVPR 2021)☆27Updated 3 years ago
- ☆103Updated last year
- Official Pytorch Implementation of SPECTRE: Visual Speech-Aware Perceptual 3D Facial Expression Reconstruction from Videos☆269Updated 6 months ago
- mediapipe landmark to mixamo skeleton☆33Updated last year
- This github contains the network architectures of NeuralVoicePuppetry.☆79Updated 4 years ago
- An unofficial implementation of "Learning-based Video Motion Magnification" in Pytorch.☆106Updated 10 months ago
- ☆32Updated 3 years ago
- Replication of speech to facial landmarks results☆9Updated 4 years ago
- ☆98Updated last year
- 3D Avatar Lip Synchronization from speech (JALI based face-rigging)☆78Updated 2 years ago
- Hair segmentation with Pytorch☆12Updated last year
- PyTorch implementation of "Lip to Speech Synthesis in the Wild with Multi-task Learning" (ICASSP2023)☆65Updated 11 months ago
- CVPR 2022: Cross-Modal Perceptionist: Can Face Geometry be Gleaned from Voices?☆128Updated 2 months ago
- Code for paper 'EAMM: One-Shot Emotional Talking Face via Audio-Based Emotion-Aware Motion Model'☆194Updated last year
- Introduction to Augmented Reality (AR) with Python 3 and OpenCV 4.2.☆124Updated last year
- improve performance of skeleton data from kinect v2 body tracking sdk using unscented kalman filter☆26Updated 4 years ago
- An avatar simulation for AirSim (https://github.com/Microsoft/AirSim).☆77Updated 2 years ago
- Vid Driven Portrait Animation 🤢😷☆18Updated 7 months ago
- Real-time speech to text with specific language translation.☆48Updated 4 years ago