NVIDIA-AI-IOT / whisper_trtLinks
A project that optimizes Whisper for low latency inference using NVIDIA TensorRT
☆86Updated 8 months ago
Alternatives and similar repositories for whisper_trt
Users that are interested in whisper_trt are comparing it to the libraries listed below
Sorting:
- ONNX and TensorRT implementation of Whisper☆63Updated 2 years ago
- ONNX implementation of Whisper. PyTorch free.☆99Updated 7 months ago
- Using FastChat-T5 Large Language Model, Vosk API for automatic speech recognition, and Piper for text-to-speech☆120Updated 2 years ago
- ☆110Updated 2 months ago
- ASR/NLP/TTS deep learning inference library for NVIDIA Jetson using PyTorch and TensorRT☆208Updated last year
- A toolkit for processing speech data and creating speech datasets☆120Updated last week
- LiteASR: Efficient Automatic Speech Recognition with Low-Rank Approximation☆110Updated last month
- Riva Python client API and CLI utils☆95Updated last week
- A high-throughput and memory-efficient inference and serving engine for Whisper, https://mesolitica.com/blog/vllm-whisper☆28Updated 10 months ago
- Zero-copy multimodal vector DB with CUDA and CLIP/SigLIP☆59Updated last month
- NVIDIA Riva runnable tutorials☆134Updated 2 weeks ago
- Use Florence 2 to auto-label data for use in training fine-tuned object detection models.☆64Updated 10 months ago
- This repository provides optical character detection and recognition solution optimized on Nvidia devices.☆76Updated last month
- A Toolkit to Help Optimize Onnx Model☆159Updated this week
- Demo python script app to interact with llama.cpp server using whisper API, microphone and webcam devices.☆46Updated last year
- ☆104Updated 3 weeks ago
- A reference example for integrating NanoOwl with Metropolis Microservices for Jetson☆30Updated last year
- Python scripts performing Open Vocabulary Object Detection using the YOLO-World model in ONNX.☆54Updated last year
- libvits-ncnn is an ncnn implementation of the VITS library that enables cross-platform GPU-accelerated speech synthesis.🎙️💻☆62Updated 2 years ago
- Using OpenVINO to speed up MeloTTS inference☆11Updated 7 months ago
- Experiments to test different speech recognition systems for SEPIA Framework☆60Updated 2 years ago
- A collection of reference AI microservices and workflows for Jetson Platform Services☆40Updated 4 months ago
- An espeak-compatible, permissively-licensed IPA phonemizer (G2P) based on DeepPhonemizer. Usable as a drop-in replacement for espeak's GP…☆99Updated 8 months ago
- A utility library to help integrate Python applications with Metropolis Microservices for Jetson☆14Updated 6 months ago
- Sample C++ command-line Riva clients.☆35Updated 2 weeks ago
- PyTorch code implementation of EfficientSpeech - to be presented at ICASSP2023.☆170Updated last year
- This project is to train an RWKV LLM for TTS generation which compatible to other TTS engine(like fish/cosy/chattts).☆77Updated this week
- Easy to use neural networks for NVIDIA Jetson (and desktop too!)☆73Updated 2 years ago
- EdgeSAM model for use with Autodistill.☆27Updated last year
- A reference application for a local AI assistant with LLM and RAG☆112Updated 6 months ago