SocAIty / py_audio2face
Use the NVIDIA Audio2Face headless server and interact with it through a requests API. Generate animation sequences for Unreal Engine 5, Maya and MetaHumans
☆101Updated 2 weeks ago
Alternatives and similar repositories for py_audio2face:
Users that are interested in py_audio2face are comparing it to the libraries listed below
- A service to convert audio to facial blendshapes for lipsyncing and facial performances.☆63Updated 3 months ago
- 3D Avatar Lip Synchronization from speech (JALI based face-rigging)☆78Updated 2 years ago
- Audio2Face Avatar with Riva SDK functionality☆73Updated 2 years ago
- The NeuroSync Player allows for real-time streaming of facial blendshapes into Unreal Engine 5 using LiveLink - enabling facial animation…☆68Updated this week
- Emotionally responsive Virtual Metahuman CV with Real-Time User Facial Emotion Detection (Unreal Engine 5).☆45Updated 2 months ago
- An open solution for AI-powered photorealistic digital humans.☆118Updated last year
- ☆221Updated last year
- Web interface to convert text to speech and route it to an Audio2Face streaming player.☆32Updated last year
- Audio to face local inference helper code.☆39Updated this week
- Send mediapipe data to unreal engine with livelink.☆43Updated last year
- ☆160Updated 2 years ago
- Pytorch reimplementation of audio driven face mesh or blendshape models, including Audio2Mesh, VOCA, etc☆14Updated 6 months ago
- SAiD: Blendshape-based Audio-Driven Speech Animation with Diffusion☆101Updated last year
- ☆188Updated 11 months ago
- A UE5 plugin for improving the Metahuman ARKit face tracking.☆92Updated last year
- ☆94Updated 3 years ago
- convert VMCProcotol to MOPProcotol☆58Updated 3 years ago
- Speech-Driven Expression Blendshape Based on Single-Layer Self-attention Network (AIWIN 2022)☆76Updated 2 years ago
- CLI tool for recording or replaying Epic Games' live link face capture frames.☆80Updated last year
- Motion Capture runtime for UE4☆79Updated 3 years ago
- Oculus LipSync Plugin compiled for Unreal Engine 5. This plugin allows you to synchronize the lips of 3D characters in your game with aud…☆93Updated last year
- Blender add-on to implement VOCA neural network.☆59Updated 2 years ago
- mediapipe landmark to mixamo skeleton☆36Updated last year
- OSC Live Link for Unreal and Hallway☆25Updated 2 years ago
- This is the official source for our ICCV 2023 paper "EmoTalk: Speech-Driven Emotional Disentanglement for 3D Face Animation"☆368Updated last year
- Create face depth frames from images using landmarks☆33Updated 4 months ago
- A multi GPU audio2face blendshape AI model trainer for your iPhone ARKit data.☆18Updated this week
- ☆157Updated 6 months ago
- [CVPR 2024] FaceTalk: Audio-Driven Motion Diffusion for Neural Parametric Head Models☆222Updated last year
- Tools to work with the Pose Camera app☆149Updated 9 months ago