asanchezyali / talking-avatar-with-ai
This project is a digital human that can talk and listen to you. It uses OpenAI's GPT to generate responses, OpenAI's Whisper to transcript the audio, Eleven Labs to generate voice and Rhubarb Lip Sync to generate the lip sync.
☆276Updated 6 months ago
Alternatives and similar repositories for talking-avatar-with-ai:
Users that are interested in talking-avatar-with-ai are comparing it to the libraries listed below
- AvaChat - is a realtime AI chat demo with animated talking heads - it uses Large Language Models (GPT, API2D GPT4, Cluade) as text inputs…☆96Updated last week
- Talking Head (3D): A JavaScript class for real-time lip-sync using Ready Player Me full-body 3D avatars.☆485Updated 3 weeks ago
- A nice 3D avatar that can speak input text with facial expressions☆346Updated 2 years ago
- Avatar Generation For Characters and Game Assets Using Deep Fakes☆216Updated 7 months ago
- Simple ExpressJS backend for talking avatars☆71Updated 2 years ago
- ☆155Updated last week
- ☆220Updated last year
- Harness the power of NVIDIA technologies and LangChain to create dynamic avatars from live speech, integrating RIVA ASR and TTS with Audi…☆62Updated 8 months ago
- ☆103Updated 4 months ago
- Explore the power of Azure Text-to-Speech with interactive talking avatar, Lisa 👩🏻🦱. Choose from multiple languages and avatar styles…☆32Updated 9 months ago
- Audio2Face Avatar with Riva SDK functionality☆73Updated 2 years ago
- This repository contains the codes of "A Lip Sync Expert Is All You Need for Speech to Lip Generation In the Wild", published at ACM Mult…☆37Updated last year
- ☆83Updated 7 months ago
- Use D-ID's live streaming API to stream a talking presenter☆189Updated 2 weeks ago
- ☆114Updated 10 months ago
- Interactable AI 3D Avatar that has control over your frontend website☆15Updated 3 months ago
- A simple voice assistant example built with Next.js and LiveKit React Components☆123Updated this week
- Text To Speech Demo in ReactJS Application using Azure Avatar AI Service.☆30Updated last year
- The API server version of the SadTalker project. Runs in Docker, 10 times faster than the original!☆130Updated last year
- ☆79Updated last year
- Zippy Talking Avatar uses Azure Cognitive Services and OpenAI API to generate text and speech. It is built with Next.js and Tailwind CSS.…☆19Updated 6 months ago
- Alternative to Flawless AI's TrueSync. Make lips in video match provided audio using the power of Wav2Lip and GFPGAN.☆119Updated 8 months ago
- A WebRTC server that allows you to interact with an LLM using your speech and responds back with generated audio.☆126Updated 9 months ago
- Low latency ai companion voice talk in 60 lines of code using faster_whisper and elevenlabs input streaming☆277Updated 9 months ago
- An open solution for AI-powered photorealistic digital humans.☆117Updated last year
- Use the NVIDIA Audio2Face headless server and interact with it through a requests API. Generate animation sequences for Unreal Engine 5, …☆100Updated last week
- A typescript demo using react and the Streaming Avatar SDK☆16Updated 8 months ago
- ☆28Updated last year
- This project is a digital human that can talk to you and is animated based on your questions. It uses the Nvidia API endpoint Meta llama3…☆48Updated 7 months ago
- Talk with AI-powered detailed 3D avatar. Use LLM, TTS, Unity, and lip sync to bring the character to life.☆65Updated 3 months ago