shahizat / JetsonGPT
Using FastChat-T5 Large Language Model, Vosk API for automatic speech recognition, and Piper for text-to-speech
☆119Updated last year
Alternatives and similar repositories for JetsonGPT:
Users that are interested in JetsonGPT are comparing it to the libraries listed below
- A project that optimizes Whisper for low latency inference using NVIDIA TensorRT☆79Updated 6 months ago
- Demo python script app to interact with llama.cpp server using whisper API, microphone and webcam devices.☆46Updated last year
- Optimized local inference for LLMs with HuggingFace-like APIs for quantization, vision/language models, multimodal agents, speech, vector…☆255Updated 6 months ago
- Pybind11 bindings for Whisper.cpp☆55Updated 2 weeks ago
- This is a Raspberry Pi 5 whisper C++ voice assistant - backwards compatible with Pi4☆21Updated last year
- Recipes for on-device voice AI and local LLM☆80Updated last month
- OpenAI Whisper for edge devices☆124Updated 2 years ago
- faster-whisper as serverless endpoint☆95Updated this week
- whisper.cpp bindings for python☆94Updated last year
- On-device speaker recognition engine powered by deep learning☆34Updated this week
- Mobile web app for audio "push-to-talk" + TTS chat interface with OpenAI-like APIs☆43Updated last year
- Speech recognition & diarisation solution with text alignment, deployed in AML pipelines☆94Updated 11 months ago
- LLaVA server (llama.cpp).☆179Updated last year
- Whisper realtime streaming for long speech-to-text transcription and translation☆113Updated last year
- Speech To Speech: an effort for an open-sourced and modular GPT4-o☆53Updated 6 months ago
- Locally running LLM with internet access☆94Updated last week
- NVIDIA Riva runnable tutorials☆129Updated last month
- Real-Time Whisper Voice Recognition with vosk model feedback.☆112Updated last year
- ☆99Updated 7 months ago
- ONNX implementation of Whisper. PyTorch free.☆92Updated 5 months ago
- This repo has the code of the 3 demos I presented at Google Gemma2 DevDay Tokyo, using Gemma2 on a Jetson Orin Nano device.☆40Updated last week
- ☆204Updated 10 months ago
- PlayHT Python SDK - AI Text-to-Speech Streaming & Voice Cloning API☆203Updated 3 weeks ago
- Deploy your GGML models to HuggingFace Spaces with Docker and gradio☆36Updated last year
- A ggml (C++) re-implementation of tortoise-tts☆178Updated 8 months ago
- Self hosted high quality voice recognition for de-googled Android using whisper. Like Siri or OK Google.☆62Updated last year
- A quick and optimized solution to manage llama based gguf quantized models, download gguf files, retreive messege formatting, add more mo…☆12Updated last year
- A project that brings the power of Large Language Models (LLM) and Retrieval-Augmented Generation (RAG) within reach of everyone, particu…☆34Updated last year
- A reference application for a local AI assistant with LLM and RAG☆109Updated 4 months ago
- Port of Suno AI's Bark in C/C++ for fast inference☆52Updated last year