joeljose / Visual-Mic
When sound hits an object, it causes small vibrations on the object’s surface. Here we show how, using only high-speed video of the object, we can extract those minute vibrations and partially recover the sound that produced them, allowing us to turn everyday objects—a glass of water, a potted plant, a box of tissues, or a bag of chips—into visu…
☆11Updated 4 months ago
Alternatives and similar repositories for Visual-Mic:
Users that are interested in Visual-Mic are comparing it to the libraries listed below
- Passive Recovery of Sound from Video☆41Updated 4 years ago
- This repository implements T. Oh, R. Jaroensri, C. Kim, M. Elgharib, F. Durand, W. Freeman, W. Matusik "Learning-based Video Motion Magni…☆37Updated 5 years ago
- Code for the project: "Audio-Driven Video-Synthesis of Personalised Moderations"☆18Updated 11 months ago
- An unofficial implementation of "Learning-based Video Motion Magnification" in Pytorch.☆105Updated 9 months ago
- Audio driven video synthesis☆41Updated 2 years ago
- The pytorch implementation of our WACV23 paper "Cross-identity Video Motion Retargeting with Joint Transformation and Synthesis".☆148Updated last year
- Deep learning model to predict a beauty score for faces in images. Outperforms the state-of-the-art by up to 18% (2019).☆25Updated 4 years ago
- ☆32Updated 3 years ago
- ☆40Updated last year
- Speech to Facial Animation using GANs☆41Updated 3 years ago
- Metrics for evaluation pose-guided image generation☆74Updated 2 years ago
- 3DGANTex: 3D Face Reconstruction with StyleGAN3-based Texture Synthesis from Multi-View Images☆41Updated 2 months ago
- Audio-driven facial animation generator with BiLSTM used for transcribing the speech and web interface displaying the avatar and the anim…☆35Updated 2 years ago
- Authors official PyTorch implementation of the "Finding Directions in GAN’s Latent Space for Neural Face Reenactment" [BMVC 2022].☆49Updated last year
- A Pytorch3D extension used in AvatarMe++ and FitMe☆47Updated last year
- Reconstruct 3D model from 2D human face images and CNN based PCA generation.☆36Updated 3 years ago
- A repository of tools implemented for 2D clothing matching and alignment for 3D clothing reconstruction and virtual try-on.☆19Updated 4 years ago
- CVPR 2022: Cross-Modal Perceptionist: Can Face Geometry be Gleaned from Voices?☆128Updated last month
- lipsync is a simple and updated Python library for lip synchronization, based on Wav2Lip. It synchronizes lips in videos and images based…☆97Updated this week
- ☆40Updated last year
- Estimating pulse remotely using video images☆19Updated 4 years ago
- Source code for: Expressive Speech-driven Facial Animation with controllable emotions☆35Updated last year
- TensorFlow port of first-order motion model. TF Lite and TF.js compatible, supports the original's checkpoints and implements in-graph kp…☆34Updated 3 years ago
- Real-Time Lip Sync for Live 2D Animation☆135Updated 5 years ago
- Code for Pose-Controllable Talking Face Generation by Implicitly Modularized Audio-Visual Representation (CVPR 2021)☆27Updated 3 years ago
- Blender add-on to implement VOCA neural network.☆58Updated 2 years ago
- Windows running repository of the pix2surf code of the paper "Learning to Transfer Texture from Clothing Images to 3D Humans"☆19Updated 4 years ago
- Implementation of Megaportrait☆45Updated 7 months ago
- This github contains the network architectures of NeuralVoicePuppetry.☆176Updated 4 years ago