marty1885 / paroli
Streaming TTS based on Piper with optional RK3588 NPU support
☆44Updated last month
Related projects ⓘ
Alternatives and complementary repositories for paroli
- My develoopment fork of llama.cpp. For now working on RK3588 NPU and Tenstorrent backend☆67Updated this week
- Run Large Language Models on RK3588 with GPU-acceleration☆86Updated last year
- Easy usage of Rockchip's NPUs found in RK3588 and similar chips☆96Updated last week
- Reverse engineering the rk3588 npu☆63Updated 5 months ago
- top-like script for rockhip NPUs on linux☆25Updated 2 weeks ago
- ☆413Updated 2 weeks ago
- Inference rwkv5 or rwkv6 with Qualcomm AI Engine Direct SDK☆37Updated last week
- Easier usage of LLMs in Rockchip's NPU on SBCs like Orange Pi 5 and Radxa Rock 5 series☆68Updated 2 weeks ago
- Efficient Inference of Transformer models☆391Updated 3 months ago
- Inference TinyLlama models on ncnn☆25Updated last year
- YoloV5 NPU for the RK3566/68/88☆81Updated 5 months ago
- ppstructure deploy by ncnn☆25Updated 4 months ago
- Using FastChat-T5 Large Language Model, Vosk API for automatic speech recognition, and Piper for text-to-speech☆111Updated last year
- Useful resources for developing with the RK3588.☆190Updated 2 weeks ago
- The rknn2 API uses the secondary encapsulation of the process, which is easy for everyone to call. It is applicable to rk356x rk3588☆44Updated 2 years ago
- Allows access via HTTP to LLM running on RK3588 NPU. Returns JSON response.☆17Updated 5 months ago
- ☆123Updated 11 months ago
- A converter for llama2.c legacy models to ncnn models.☆82Updated 11 months ago
- Infere RWKV on NCNN☆48Updated 2 months ago
- ☆655Updated 11 months ago
- some ncnn demos of FunASR☆18Updated last month
- MLC Stable Diffusion for RK3588's Mali GPU☆37Updated 2 months ago
- ☆25Updated 5 months ago
- A Toolkit to Help Optimize Large Onnx Model☆148Updated 6 months ago
- A project that optimizes Whisper for low latency inference using NVIDIA TensorRT☆63Updated last month
- InspireFace is a cross-platform face recognition SDK developed in C/C++, supporting multiple operating systems and various backend types …☆72Updated this week
- ☆82Updated last year
- A rockchip-mpp V4L2 wrapper plugin for chromium V4L2 VDA/VEA☆85Updated 5 months ago
- OpenAI Whisper for edge devices☆115Updated last year
- RKNN模型推理部署模板☆18Updated last year