This project is a digital human that can talk to you and is animated based on your questions. It uses the Nvidia API endpoint Meta llama3-70b to generate responses, Eleven Labs to generate voice and Rhubarb Lip Sync to generate the lip sync.
☆63Jul 31, 2024Updated last year
Alternatives and similar repositories for nvidia-human-ai-lipsync
Users that are interested in nvidia-human-ai-lipsync are comparing it to the libraries listed below
Sorting:
- This project is a digital human that can talk and listen to you. It uses OpenAI's GPT to generate responses, OpenAI's Whisper to transcri…☆416Jan 18, 2026Updated last month
- LipSync AI is your ultimate solution for flawless lip-syncing in videos. Our AI model precisely synchronizes audio and video, creating li…☆15Jul 18, 2023Updated 2 years ago
- Creates video from TTS output and viseme images.☆16Jun 18, 2022Updated 3 years ago
- This repository is an offical PyTorch implementation of SD-GAN: Semantic Decomposition for Face Image Synthesis with Discrete Attribute.☆13Mar 18, 2024Updated last year
- ☆13Jul 17, 2024Updated last year
- It means to reciprocate the motion from video to human face and looks like the real man talking video. In this module you will find the …☆13Oct 28, 2020Updated 5 years ago
- ☆20Oct 4, 2025Updated 5 months ago
- ☆12May 31, 2024Updated last year
- ☆13May 11, 2024Updated last year
- 虚拟主播，是通过计算机画出来的，并不存在于这个世界上。☆14Jan 4, 2022Updated 4 years ago
- [BMVC'24] G3FA: Geometry-guided GAN for Face Animation☆20Mar 14, 2025Updated 11 months ago
- SyncTalkFace: Talking Face Generation for Precise Lip-syncing via Audio-Lip Memory☆33Nov 3, 2022Updated 3 years ago
- Modify-Anything is based on yolov5,yolov8 for video and image detection. Segment-anything,lama_cleaner is applied to segment, modify, era…☆17May 3, 2023Updated 2 years ago
- 区块链电子证据保全项目☆14Jan 13, 2019Updated 7 years ago
- ☆18Nov 13, 2021Updated 4 years ago
- AI Lip Syncing application, deployed on Streamlit☆44Feb 28, 2024Updated 2 years ago
- PyCes (Python Code Scanner) - Enhanced Security Static Analysis Tool for Python☆11Apr 18, 2019Updated 6 years ago
- HairNet: Hairstyle Transfer with Pose Changes☆18Jul 20, 2022Updated 3 years ago
- A quality zero-shot lipsync pipeline built with MuseTalk, LivePortrait, and CodeFormer.☆49Sep 25, 2024Updated last year
- Audio-Visual Lip Synthesis via Intermediate Landmark Representation☆18May 16, 2023Updated 2 years ago
- An Augmented-Reality web-based Fitting-room experience☆14Mar 3, 2021Updated 5 years ago
- Face Parsing via SegNeXt, trained on CelebAMask-HQ☆16Dec 21, 2023Updated 2 years ago
- ☆34Jan 4, 2022Updated 4 years ago
- Talking Face Generation system☆19Oct 16, 2023Updated 2 years ago
- optimized wav2lip☆18Jan 6, 2024Updated 2 years ago
- Virtual Fashion TryON - Fashion(Garment) transfer on a given target using Deep learning.☆21Mar 29, 2021Updated 4 years ago
- ☆25Feb 11, 2023Updated 3 years ago
- RePlan: Reasoning-Guided Region Planning for Complex Instruction-Based Image Editing☆58Dec 26, 2025Updated 2 months ago
- Recognize speech from an audio file and convert it into animation FBX☆24Mar 7, 2022Updated 4 years ago
- [EMNLP 2024] Ask-before-Plan: Proactive Language Agents for Real-World Planning☆21Jul 28, 2025Updated 7 months ago
- Oculus Lip Sync Compiled for Unreal 5☆69Feb 20, 2026Updated 2 weeks ago
- A 28× Compressed Wav2Lip for Efficient Talking Face Generation [ICCV'23 Demo] [MLSys'23 Workshop] [NVIDIA GTC'23]☆60Mar 8, 2024Updated 2 years ago
- 这是一个基于魔珐星云sdk构建的智能虚拟人交互演示应用，集成了语音识别、大语言模型和虚拟人SDK，提供完整的语音交互体验。支持连接Fay使用。☆61Nov 12, 2025Updated 3 months ago
- ☆10Nov 10, 2022Updated 3 years ago
- Zanime是一个基于 Gin (Go) + Vue3 构建的分布式动漫资源聚合平台，实现从数据采集到用户交互的完整技术闭环，项目集成了视频观看、社区互动、评论交流、交易功能以及资源 搜索等服务☆12Mar 11, 2025Updated 11 months ago
- A simple demo application showcasing the power of Gemini 1.5 Pro's video understanding capabilities.☆31May 24, 2024Updated last year
- Talking head animation☆28Dec 8, 2023Updated 2 years ago
- Realtime diffusion (LCM-LoRA) from screen capture or webcam, for architecture, using torch and Pyside6☆29Feb 13, 2024Updated 2 years ago
- AvaChat - is a realtime AI chat demo with animated talking heads - it uses Large Language Models via api (OpenAI and Claude) as text inpu…☆113Apr 30, 2025Updated 10 months ago