shahizat / jetsonGPT
Using FastChat-T5 Large Language Model, Vosk API for automatic speech recognition, and Piper for text-to-speech
☆111Updated last year
Related projects ⓘ
Alternatives and complementary repositories for jetsonGPT
- This is a Raspberry Pi 5 whisper C++ voice assistant - backwards compatible with Pi4☆18Updated 11 months ago
- Demo python script app to interact with llama.cpp server using whisper API, microphone and webcam devices.☆45Updated last year
- On-device LLM Inference Powered by X-Bit Quantization☆189Updated this week
- A project that optimizes Whisper for low latency inference using NVIDIA TensorRT☆63Updated last month
- Open source repo for AI in a Box.☆56Updated 7 months ago
- Recipes for on-device voice AI and local LLM☆66Updated this week
- A quick and optimized solution to manage llama based gguf quantized models, download gguf files, retreive messege formatting, add more mo…☆12Updated 10 months ago
- Efficient approach to speaker diarization using voice characteristics extraction☆68Updated 6 months ago
- OpenAI Whisper for edge devices☆115Updated last year
- Self hosted high quality voice recognition for de-googled Android using whisper. Like Siri or OK Google.☆53Updated 10 months ago
- Like ChatGPT's voice conversations with an AI, but entirely offline/private/trade-secret-friendly, using local AI models such as LLama 2 …☆137Updated 3 months ago
- Speech recognition & diarisation solution with text alignment, deployed in AML pipelines☆84Updated 6 months ago
- An OpenAI API compatible speech to text server for audio transcription and translations, aka. Whisper.☆47Updated 8 months ago
- whisper.cpp bindings for python☆77Updated last year
- A ggml (C++) re-implementation of tortoise-tts☆159Updated 3 months ago
- Simulates talk with an AI that can express emotions☆30Updated 3 months ago
- Pybind11 bindings for Whisper.cpp☆45Updated 2 weeks ago
- Whisper realtime streaming for long speech-to-text transcription and translation☆103Updated 9 months ago
- On-device streaming text-to-speech engine powered by deep learning☆56Updated 2 weeks ago
- ONNX and TensorRT implementation of Whisper☆59Updated last year
- Optimized local inference for LLMs with HuggingFace-like APIs for quantization, vision/language models, multimodal agents, speech, vector…☆197Updated last month
- Real-Time Whisper Voice Recognition with vosk model feedback.☆105Updated last year
- This repo has the code of the 3 demos I presented at Google Gemma2 DevDay Tokyo, using Gemma2 on a Jetson Orin Nano device.☆22Updated 3 weeks ago
- Accepts a Hugging Face model URL, automatically downloads and quantizes it using Bits and Bytes.☆38Updated 8 months ago
- ASR/NLP/TTS deep learning inference library for NVIDIA Jetson using PyTorch and TensorRT☆189Updated 9 months ago
- LLaVA server (llama.cpp).☆177Updated last year
- Realtime tts reading of large textfiles by your favourite voice. +Translation via LLM (Python script)☆47Updated last month
- Local LLM inference & management server with built-in OpenAI API☆31Updated 7 months ago
- ☆296Updated 4 months ago
- An endpoint server for efficiently serving quantized open-source LLMs for code.☆54Updated last year