shahizat / JetsonGPT
Using FastChat-T5 Large Language Model, Vosk API for automatic speech recognition, and Piper for text-to-speech
☆117Updated last year
Alternatives and similar repositories for JetsonGPT:
Users that are interested in JetsonGPT are comparing it to the libraries listed below
- This is a Raspberry Pi 5 whisper C++ voice assistant - backwards compatible with Pi4☆20Updated last year
- Pybind11 bindings for Whisper.cpp☆54Updated 3 weeks ago
- A project that optimizes Whisper for low latency inference using NVIDIA TensorRT☆74Updated 5 months ago
- streaming speech to text server using Whisper☆90Updated last year
- ASR/NLP/TTS deep learning inference library for NVIDIA Jetson using PyTorch and TensorRT☆203Updated last year
- OpenAI Whisper for edge devices☆124Updated 2 years ago
- Self hosted high quality voice recognition for de-googled Android using whisper. Like Siri or OK Google.☆61Updated last year
- Demo python script app to interact with llama.cpp server using whisper API, microphone and webcam devices.☆46Updated last year
- Efficient Inference of Transformer models☆426Updated 7 months ago
- Like ChatGPT's voice conversations with an AI, but entirely offline/private/trade-secret-friendly, using local AI models such as LLama 2 …☆155Updated 7 months ago
- Optimized local inference for LLMs with HuggingFace-like APIs for quantization, vision/language models, multimodal agents, speech, vector…☆249Updated 5 months ago
- Recipes for on-device voice AI and local LLM☆78Updated last week
- Deploy your GGML models to HuggingFace Spaces with Docker and gradio☆36Updated last year
- NVIDIA Riva runnable tutorials☆127Updated this week
- On-device LLM Inference Powered by X-Bit Quantization☆224Updated last week
- Speech To Speech: an effort for an open-sourced and modular GPT4-o☆45Updated 5 months ago
- Whisper realtime streaming for long speech-to-text transcription and translation☆113Updated last year
- ONNX implementation of Whisper. PyTorch free.☆92Updated 4 months ago
- Mobile web app for audio "push-to-talk" + TTS chat interface with OpenAI-like APIs☆42Updated last year
- 🎧 | RunPod worker of the faster-whisper model for Serverless Endpoint.☆89Updated last month
- Efficient approach to speaker diarization using voice characteristics extraction☆92Updated 11 months ago
- Open source repo for AI in a Box.☆63Updated 11 months ago
- A quick and optimized solution to manage llama based gguf quantized models, download gguf files, retreive messege formatting, add more mo…☆12Updated last year
- ONNX and TensorRT implementation of Whisper☆61Updated last year
- An OpenAI API compatible speech to text server for audio transcription and translations, aka. Whisper.☆70Updated last month
- On-device streaming text-to-speech engine powered by deep learning☆73Updated last week
- Streaming TTS based on Piper with optional RK3588 NPU support☆71Updated 3 months ago
- Run Large Language Models on RK3588 with GPU-acceleration☆94Updated last year
- whisper.cpp bindings for python☆92Updated last year
- Experiments to test different speech recognition systems for SEPIA Framework☆59Updated last year