marty1885 / paroliLinks
Streaming TTS based on Piper with optional RK3588 NPU support
☆106Updated 4 months ago
Alternatives and similar repositories for paroli
Users that are interested in paroli are comparing it to the libraries listed below
Sorting:
- Run Large Language Models on RK3588 with GPU-acceleration☆117Updated 2 years ago
- Efficient Inference of Transformer models☆459Updated last year
- My develoopment fork of llama.cpp. For now working on RK3588 NPU and Tenstorrent backend☆108Updated this week
- top-like script for rockhip NPUs on linux☆53Updated last month
- Reverse engineering the rk3588 npu☆95Updated last year
- Allows access via HTTP to LLM running on RK3588 NPU. Returns JSON response.☆25Updated last year
- Easier usage of LLMs in Rockchip's NPU on SBCs like Orange Pi 5 and Radxa Rock 5 series☆149Updated last month
- Easy installation and usage of Rockchip's NPUs found in RK3588 and similar SoCs☆181Updated last month
- A lightweight pure C++ Text-to-Speech (TTS) pipeline with OpenVINO, supporting multiple languages.☆77Updated last month
- Experiments to test different speech recognition systems for SEPIA Framework☆60Updated 2 years ago
- ☆49Updated 7 months ago
- ONNX implementation of Whisper. PyTorch free.☆99Updated 10 months ago
- Ollama alternative for Rockchip NPU: An efficient solution for running AI and Deep learning models on Rockchip devices with optimized NPU…☆286Updated last week
- Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK☆81Updated last week
- YoloV5 NPU for the RK3566/68/88☆112Updated last year
- A project that optimizes Whisper for low latency inference using NVIDIA TensorRT☆90Updated 11 months ago
- 将LLM 模型部署到 Rockchip Rk3588芯片中,在开发板上使用NPU进行推理☆58Updated 11 months ago
- ☆972Updated 2 months ago
- A ggml (C++) re-implementation of tortoise-tts☆188Updated last year
- Port of Facebook's LLaMA model in C/C++☆57Updated 4 months ago
- A Toolkit to Help Optimize Onnx Model☆214Updated last week
- Automated script to convert Huggingface and GGUF models to rkllm format for running on Rockchip NPU☆35Updated 10 months ago
- OpenAI Whisper for edge devices☆129Updated 2 years ago
- ONNX and TensorRT implementation of Whisper☆64Updated 2 years ago
- Explore LLM model deployment based on AXera's AI chips☆113Updated last month
- Inference RWKV with multiple supported backends.☆59Updated this week
- Utilizes ONNX Runtime to transcribe audio into text.☆52Updated last week
- mnn tts demo.☆18Updated 4 months ago
- Useful resources for developing with the RK3588.☆355Updated 4 months ago
- A Rust-based, OpenAI-style API server for large language models (LLMs)☆15Updated 2 weeks ago