AnimaVR / NeuroSync_Player
The NeuroSync Player allows for real-time streaming of facial blendshapes into Unreal Engine 5 using LiveLink - enabling facial animation from audio input.
☆77Updated this week
Alternatives and similar repositories for NeuroSync_Player:
Users that are interested in NeuroSync_Player are comparing it to the libraries listed below
- Audio to face local inference helper code.☆46Updated 3 weeks ago
- A multi GPU audio2face blendshape AI model trainer for your iPhone ARKit data.☆21Updated 3 weeks ago
- Use the NVIDIA Audio2Face headless server and interact with it through a requests API. Generate animation sequences for Unreal Engine 5, …☆106Updated last month
- A collection of AI model endpoints you can run locally for a real-time audio2face system. Toy demonstration, not for production. Use this…☆13Updated last week
- Create face depth frames from images using landmarks☆35Updated 4 months ago
- A service to convert audio to facial blendshapes for lipsyncing and facial performances.☆76Updated 2 weeks ago
- Audio2Face Avatar with Riva SDK functionality☆73Updated 2 years ago
- Emotionally responsive Virtual Metahuman CV with Real-Time User Facial Emotion Detection (Unreal Engine 5).☆45Updated 3 months ago
- Web interface to convert text to speech and route it to an Audio2Face streaming player.☆33Updated last year
- An open solution for AI-powered photorealistic digital humans.☆122Updated last year
- 3D Avatar Lip Synchronization from speech (JALI based face-rigging)☆80Updated 3 years ago
- The source code of "DINet: deformation inpainting network for realistic face visually dubbing on high resolution video."☆38Updated 7 months ago
- Official implementation for the SIGGRAPH Asia 2024 paper SPARK: Self-supervised Personalized Real-time Monocular Face Capture☆365Updated 2 months ago
- Face Depth Frame Mancer Documentation☆23Updated 3 months ago
- A UE5 plugin for improving the Metahuman ARKit face tracking.☆93Updated last year
- ☆416Updated this week
- [CVPR 2024] Official Code for "AiOS: All-in-One-Stage Expressive Human Pose and Shape Estimation☆307Updated 2 weeks ago
- Fast running Live Portrait with TensorRT and ONNX models☆160Updated 8 months ago
- Oculus LipSync Plugin compiled for Unreal Engine 5. This plugin allows you to synchronize the lips of 3D characters in your game with aud…☆94Updated 2 years ago
- UE5 MediaPipe free plugin motion capture and facial☆12Updated 2 years ago
- Offical implement of Dynamic Frame Avatar with Non-autoregressive Diffusion Framework for talking head Video Generation☆220Updated 3 weeks ago
- Pytorch reimplementation of audio driven face mesh or blendshape models, including Audio2Mesh, VOCA, etc☆14Updated 7 months ago
- Orchestrating AI for stunning lip-synced videos. Effortless workflow, exceptional results, all in one place.☆69Updated 9 months ago
- This Unreal Engine sample project demonstrates how to bring Epic Games' MetaHuman digital characters to life using the Amazon Polly text-…☆50Updated last year
- ☆223Updated last year
- Send mediapipe data to unreal engine with livelink.☆44Updated 2 years ago
- ☆192Updated last year
- Official PyTorch implementation of "Expressive Whole-Body 3D Gaussian Avatar", ECCV 2024.☆561Updated 4 months ago
- 🔊 Text2Speech, Voice-Cloning and Voice2Voice conversion with the text-prompted generative audio model bark☆61Updated 3 weeks ago
- Hallo: Hierarchical Audio-Driven Visual Synthesis for Portrait Image Animation☆203Updated 10 months ago