shahizat / jetsonGPT
Using FastChat-T5 Large Language Model, Vosk API for automatic speech recognition, and Piper for text-to-speech
☆97Updated last year
Related projects: ⓘ
- Pybind11 bindings for Whisper.cpp☆38Updated 2 weeks ago
- This is a Raspberry Pi 5 whisper C++ voice assistant - backwards compatible with Pi4☆18Updated 9 months ago
- Demo python script app to interact with llama.cpp server using whisper API, microphone and webcam devices.☆44Updated 10 months ago
- Open source repo for AI in a Box.☆52Updated 4 months ago
- whisper.cpp bindings for python☆68Updated last year
- Optimized local inference for LLMs with HuggingFace-like APIs for quantization, vision/language models, multimodal agents, speech, vector…☆171Updated 2 weeks ago
- OpenAI Whisper for edge devices☆111Updated last year
- On-device LLM Inference Powered by X-Bit Quantization☆159Updated this week
- Efficient Inference of Transformer models☆353Updated last month
- Locally running LLM with internet access☆91Updated 2 weeks ago
- ASR/NLP/TTS deep learning inference library for NVIDIA Jetson using PyTorch and TensorRT☆180Updated 7 months ago
- Recipes for on-device voice AI and local LLM☆63Updated this week
- Self hosted high quality voice recognition for de-googled Android using whisper. Like Siri or OK Google.☆51Updated 8 months ago
- A project that optimizes Whisper for low latency inference using NVIDIA TensorRT☆47Updated 2 months ago
- Python bindings for whisper.cpp☆150Updated this week
- streaming speech to text server using Whisper☆75Updated last year
- LLaVA server (llama.cpp).☆173Updated 10 months ago
- Efficient approach to speaker diarization using voice characteristics extraction☆56Updated 4 months ago
- On-device streaming text-to-speech engine powered by deep learning☆43Updated last week
- Like ChatGPT's voice conversations with an AI, but entirely offline/private/trade-secret-friendly, using local AI models such as LLama 2 …☆128Updated 3 weeks ago
- Run Large Language Models on RK3588 with GPU-acceleration☆80Updated last year
- A ggml (C++) re-implementation of tortoise-tts☆147Updated 3 weeks ago
- Caption, translate, and optionally record in real time "what you hear" from speakers and microphone. Never miss part of the conversation …☆13Updated 6 months ago
- Whisper realtime streaming for long speech-to-text transcription and translation☆97Updated 7 months ago
- An OpenAI API compatible API for chat with image input and questions about the images. aka Multimodal.☆157Updated this week
- Provide Gradio custom components to make the diarization-based audio labeling process easier and faster.☆34Updated this week
- Speech recognition & diarisation solution with text alignment, deployed in AML pipelines☆81Updated 4 months ago
- Real-time Voice Activity Detection (VAD) with some example use case like simple voice bot and live transcription (realtime transcription)☆43Updated 3 months ago
- Live transcription with OpenAi Whisper☆50Updated last year
- NVIDIA Riva runnable tutorials☆115Updated last month