joeljose / Visual-Mic
When sound hits an object, it causes small vibrations on the object’s surface. Here we show how, using only high-speed video of the object, we can extract those minute vibrations and partially recover the sound that produced them, allowing us to turn everyday objects—a glass of water, a potted plant, a box of tissues, or a bag of chips—into visu…
☆12Updated 7 months ago
Alternatives and similar repositories for Visual-Mic:
Users that are interested in Visual-Mic are comparing it to the libraries listed below
- Passive Recovery of Sound from Video☆42Updated 4 years ago
- INSTA - Instant Volumetric Head Avatars [CVPR2023]☆478Updated last month
- An unofficial implementation of "Learning-based Video Motion Magnification" in Pytorch.☆111Updated 2 weeks ago
- Blender add-on to implement VOCA neural network.☆59Updated 2 years ago
- A Pytorch3D extension used in AvatarMe++ and FitMe☆49Updated last year
- CVPR 2022: Cross-Modal Perceptionist: Can Face Geometry be Gleaned from Voices?☆129Updated 3 months ago
- X-Avatar: Expressive Human Avatars (CVPR2023)☆396Updated 10 months ago
- Official Repository for CVPR 2023 paper PointAvatar: Deformable Point-based Head Avatars from Videos.☆332Updated last year
- This repository implements T. Oh, R. Jaroensri, C. Kim, M. Elgharib, F. Durand, W. Freeman, W. Matusik "Learning-based Video Motion Magni…☆40Updated 5 years ago
- Public repository for the CVPR 2020 paper AvatarMe and the TPAMI 2021 AvatarMe++☆172Updated last year
- Implementation of a 3D Face Generative Model☆94Updated last year
- Metrical Monocular Photometric Tracker [ECCV2022]☆336Updated last year
- ☆80Updated 2 months ago
- A python library to to fit 3D morphable models to images of faces and capture facial performance overtime with no markers or a special mo…☆75Updated 11 months ago
- PyTorch implementations for our SIGGRAPH 2021 paper: Editable Free-viewpoint Video Using a Layered Neural Representation.☆299Updated 2 years ago
- A repository for generating stylized talking 3D and 3D face☆279Updated 3 years ago
- Code for "Animating Portrait Line Drawings from a Single Face Photo and a Speech Signal"☆56Updated 2 years ago
- ☆40Updated last year
- Authors official PyTorch implementation of the "Finding Directions in GAN’s Latent Space for Neural Face Reenactment" [BMVC 2022].☆50Updated last year
- Official Pytorch Implementation of SPECTRE: Visual Speech-Aware Perceptual 3D Facial Expression Reconstruction from Videos☆271Updated last week
- Official repository for 'GaussianHead: High-fidelity Head Avatars with Learnable Gaussian Derivation'☆259Updated 7 months ago
- Realistic mesh-based avatars. ECCV 2022☆434Updated last year
- 3DGANTex: 3D Face Reconstruction with StyleGAN3-based Texture Synthesis from Multi-View Images☆50Updated last month
- [CVPR'23] Learning Neural Parametric Head Models☆257Updated 9 months ago
- ☆21Updated 3 years ago
- Learning Disentangled Avatars with Hybrid 3D Representations. (Face, Body, Hair and Clothing)☆254Updated last year
- ☆100Updated last year
- FaceFormer Emo: Speech-Driven 3D Facial Animation with Emotion Embedding☆25Updated last year
- Reconstruct 3D model from 2D human face images and CNN based PCA generation.☆36Updated 3 years ago
- 3D Avatar Lip Synchronization from speech (JALI based face-rigging)☆78Updated 2 years ago