Drop-in ggml backend for Rockchip NPUs: offloads llama.cpp/whisper.cpp prefill to the RK3588 NPU
☆24Oct 13, 2026Updated last week
Alternatives and similar repositories for ggml-rocket
Users that are interested in ggml-rocket are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Quick and dirty benchmarking tool to measure the performance of RK3588 NPU.☆12Feb 23, 2024Updated 2 years ago
- ☆13Jan 31, 2024Updated 2 years ago
- ☆33Aug 4, 2026Updated 2 months ago
- Export and Run Hugging Face Transformers Models on Rockchip NPUs☆28Dec 2, 2025Updated 10 months ago
- Deploy streaming ASR + TTS on RK3576/RK3588 — 120ms TTS, 52-language ASR, one Docker command☆43Oct 12, 2026Updated last week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Run ops on Apple ANE in NPU register with pure python on M1 Asahi Linux. No Espresso, No CoreML, no metal, no .mlmodels file, no .hwx fil…☆21Oct 8, 2026Updated last week
- ☆52Jun 26, 2026Updated 3 months ago
- GEMMs with metal☆26Oct 5, 2026Updated 2 weeks ago
- Fully typesafe nextjs-ai-starter using 2 agents/tools out of the box https://nextjs.ai☆12Jun 14, 2023Updated 3 years ago
- Modern Golang YaCy node☆22Oct 7, 2026Updated last week
- High-performance system monitor for Rockchip SoCs (RK3588, RK3399) with real-time CPU, GPU, NPU, RGA, memory, and process monitoring. W…☆35Nov 25, 2025Updated 10 months ago
- ☆16Mar 25, 2024Updated 2 years ago
- ☆11Apr 18, 2023Updated 3 years ago
- An example of distributed tracing an MCP enabled agent☆15Feb 14, 2026Updated 8 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Speeds up TTFT☆21Sep 25, 2026Updated 3 weeks ago
- Creating Generative AI Apps which work☆17Apr 14, 2025Updated last year
- Daily Positive Thoughts Emails☆10Jan 5, 2025Updated last year
- Production LLM inference on the Apple Neural Engine — a practitioner's guide, complete with converters, Swift runtimes, and validated mod…☆46Jun 7, 2026Updated 4 months ago
- Vectorstores is a framework for using vector databases in your AI applications☆18Mar 16, 2026Updated 7 months ago
- Collect lscpu reports and find processor model details☆16Mar 21, 2022Updated 4 years ago
- enable vulkan on mali610☆29Oct 30, 2024Updated last year
- ☆25Apr 18, 2023Updated 3 years ago
- ☆19Aug 25, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- OptiScaler fork: DLSS 5 Neural Rendering, much cheaper and steadier (pre-SR, edit cache, multi-pass)☆68Oct 10, 2026Updated last week
- Dockerfiles for poetry/mlc-llm(rk3588)/...☆10Sep 13, 2023Updated 3 years ago
- This project showcases the use of an ESP32-CAM with micro-ROS and an OLED screen to capture an image of a hand. The captured image is enc…☆10Sep 24, 2024Updated 2 years ago
- Additional camera tuning profiles for Rockchip SoC☆18Oct 8, 2026Updated last week
- Transcoding optimizations for Synology Photo☆14Sep 27, 2026Updated 3 weeks ago
- some simulation models of various processes (just for fun)☆10Feb 5, 2024Updated 2 years ago
- A ROS2 Compatible node that interfaces with the BNO085 IMU sensor via python☆13Feb 28, 2026Updated 7 months ago
- The Python SDK for the Frame from @brilliantlabsAR☆17Apr 1, 2025Updated last year
- experimental ui (underconstruction)☆15May 2, 2025Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆155Aug 31, 2026Updated last month
- Automated converter for ONNX models (particularly ESRGAN) to RKNN format for Rockchip NPUs. Features include Docker-based conversion and …☆28May 18, 2025Updated last year
- ☆32Mar 13, 2025Updated last year
- ☆10Dec 30, 2022Updated 3 years ago
- This repository contains guide on how to setup toolkits to use NPU present on Axon for running various CNN models☆37Sep 24, 2026Updated 3 weeks ago
- Modify the atheros wireless driver to enable the card to initiate radiation (IR) on 5GHz bands for AP mode☆13Sep 30, 2022Updated 4 years ago
- The United States Code in readable, editable Markdown.☆16May 20, 2022Updated 4 years ago