lukerbs / pytoon
PyToon is a Python based animation library for automatically animating a cartoon character's mouth movements and bodily expressions to sync with an audio recording of someone talking. PyToon uses machine learning based audio analysis techniques to automatically generate lip-synced character animations (see "Example Output Video" in README).
☆32Updated 2 months ago
Alternatives and similar repositories for pytoon:
Users that are interested in pytoon are comparing it to the libraries listed below
- （CVPR 2023）SadTalker：Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animation☆28Updated 8 months ago
- AI Talking Head: create video from plain text or audio file in minutes, support up to 100+ languages and 350+ voice models.☆33Updated 2 years ago
- One-shot face animation using webcam, capable of running in real time.☆35Updated 8 months ago
- Orchestrating AI for stunning lip-synced videos. Effortless workflow, exceptional results, all in one place.☆68Updated 7 months ago
- Using a single image and just 10 seconds of sample audio, our project enables you to create a video where it appears as if you're speakin…☆34Updated last year
- lipsync is a simple and updated Python library for lip synchronization, based on Wav2Lip. It synchronizes lips in videos and images based…☆106Updated last month
- [ICCV 2023]ToonTalker: Cross-Domain Face Reenactment☆115Updated 3 months ago
- Face Animation from Text☆14Updated 6 months ago
- AI-Powered animation tool☆49Updated 3 years ago
- The objective of the Speaking Portal Project is to design, develop, and deploy a lip-sync animation API for the Kukarella text-to-speech …☆11Updated last year
- ✨ Experience the enchantment of Story Blocks: an open-source project merging AI text generation and image synthesis to create captivating…☆57Updated last year
- High-performance ASR tool using Faster Whisper, supporting custom models, multi-language transcription, and real-time processing feedback…☆10Updated 3 months ago
- AvaChat - is a realtime AI chat demo with animated talking heads - it uses Large Language Models (GPT, API2D GPT4, Cluade) as text inputs…☆89Updated 3 months ago
- Avatar Generation For Characters and Game Assets Using Deep Fakes☆214Updated 6 months ago
- Long-Inference, High Quality Synthetic Speaker (AI avatar/ AI presenter)☆250Updated last year
- Automatically generate a lip-synced avatar based off of a transcript and audio☆14Updated 2 years ago
- AI Lip Syncing application, deployed on Streamlit☆38Updated 11 months ago
- Alternative to Flawless AI's TrueSync. Make lips in video match provided audio using the power of Wav2Lip and GFPGAN.☆117Updated 7 months ago
- Convert your PDFs into audiobooks effortlessly. Features intelligent text extraction, customizable text-to-speech settings, and efficient…☆44Updated last week
- Misc. tools/scripts that I made to use for tortoise☆22Updated 6 months ago
- Multivoice: Enhance your foreign-language movie and TV show experience with personalized dubbed versions. Our project uses voice cloning …☆26Updated last year
- Multiple python based scripts used for video and image editing☆50Updated last month
- Daily tracking of awesome avatar papers, including 2d talking head, 3d head avatar, body avatar.☆60Updated this week
- A curated list of 'Talking Head Generation' resources. Features influential papers, groundbreaking algorithms, crucial GitHub repositorie…☆75Updated last year
- AI 3D avatar voice interface in browser. VAD -> STT -> LLM -> TTS -> VRM (Prototype/Proof-of-Concept)☆65Updated last year
- This repository contains the codes of "A Lip Sync Expert Is All You Need for Speech to Lip Generation In the Wild", published at ACM Mult…☆36Updated last year
- VoiceCraftAI is a revolutionary AI tool to dub videos into multiple regional languages and lip-sync at the same time.☆57Updated 4 months ago
- SadTalker gradio_demo.py file with code section that allows you to set the eye blink and pose reference videos for the software to use wh…☆11Updated last year
- Video to video translation via few shot voice cloning & audio-based lip sync☆25Updated 7 months ago
- Audio-driven facial animation generator with BiLSTM used for transcribing the speech and web interface displaying the avatar and the anim…☆35Updated 2 years ago