liukuangxiangzi / audio2viseme
The code generate phoneme from audio features.
☆29Updated 3 years ago
Alternatives and similar repositories for audio2viseme:
Users that are interested in audio2viseme are comparing it to the libraries listed below
- 3D Avatar Lip Synchronization from speech (JALI based face-rigging)☆80Updated 3 years ago
- ☆95Updated 3 years ago
- 中文到表情☆29Updated 2 years ago
- ☆12Updated 2 years ago
- CPU inference version of VisemeNet-tensorflow☆14Updated 5 years ago
- Blender add-on to implement VOCA neural network.☆59Updated 2 years ago
- CLI tool for recording or replaying Epic Games' live link face capture frames.☆80Updated last year
- Audio-driven facial animation generator with BiLSTM used for transcribing the speech and web interface displaying the avatar and the anim…☆35Updated 2 years ago
- ☆196Updated 3 years ago
- Pose Asset with visemes for Epic's MetaHuman face skeleton☆51Updated 2 years ago
- FaceFormer Emo: Speech-Driven 3D Facial Animation with Emotion Embedding☆25Updated last year
- This repository contains the gesture generation model from the paper "Moving Fast and Slow" (https://www.tandfonline.com/doi/full/10.1080…☆25Updated 2 years ago
- Web-first SDK that provides real-time ARKit-compatible 52 blend shapes from a camera feed, video or image at 60 FPS using ML models.☆84Updated 2 years ago
- A pipeline from Dataset Gathering,Data annotations, Model training,Model Evaluation for viseme (visual sound phoneme) classification☆14Updated 4 years ago
- ☆100Updated last year
- mediapipe landmark to mixamo skeleton☆37Updated last year
- implementation based on "Audio-Driven Facial Animation by Joint End-to-End Learning of Pose and Emotion"☆162Updated 5 years ago
- The official implementation for ICMI 2020 Best Paper Award "Gesticulator: A framework for semantically-aware speech-driven gesture gener…☆125Updated 2 years ago
- Code for the project: "Audio-Driven Video-Synthesis of Personalised Moderations"☆19Updated last year
- Speech-Driven Expression Blendshape Based on Single-Layer Self-attention Network (AIWIN 2022)☆76Updated 2 years ago
- OSC Live Link for Unreal and Hallway☆25Updated 2 years ago
- SAiD: Blendshape-based Audio-Driven Speech Animation with Diffusion☆101Updated last year
- Emotionally responsive Virtual Metahuman CV with Real-Time User Facial Emotion Detection (Unreal Engine 5).☆45Updated 3 months ago
- Pytorch reimplementation of audio driven face mesh or blendshape models, including Audio2Mesh, VOCA, etc☆14Updated 7 months ago
- Audio driven video synthesis☆41Updated 2 years ago
- Drive your metahuman to speak within 1 second.☆5Updated 3 weeks ago
- Speech to Facial Animation using GANs☆40Updated 3 years ago
- Crystal TTVS engine is a real-time audio-visual Multilingual speech synthesizer with a 3D expressive avatar.☆84Updated 4 years ago
- Mirror : a maya facial capture animation toolkit based on mediapipe☆22Updated 2 years ago
- SyncTalkFace: Talking Face Generation for Precise Lip-syncing via Audio-Lip Memory☆33Updated 2 years ago