llama.cpp on the Rockchip RK3588 NPU - RKNPU2 backend by @invisiofficial, rebased onto current upstream, with MoE experts on the NPU, cross-board tensor parallelism and a measurement study
☆11Jul 31, 2026Updated 3 months ago
Alternatives and similar repositories for rk-llama.cpp
Users that are interested in rk-llama.cpp are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- LoAS: Fully Temporal-Parallel Dataflow for Dual-Sparse Spiking Neural Networks, MICRO 2024.☆22Mar 19, 2025Updated last year
- ☆12Nov 6, 2026Updated last week
- Kodi master (GBM) with hw video decoding for Rockchip on Armbian, as containers & .debs. Two flavors: rkmpp (vendor kernel; ffmpeg-rockch…☆21Updated this week
- Variant 1 of the Spectre attack which is to bypass the bounds checks in the target process and retrieve the private data. Here in this ex…☆11Jul 21, 2020Updated 6 years ago
- XPS15-9560-Catalina, Q群:161385229☆10Nov 18, 2020Updated 5 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Rk3588-NAS Hardware☆10Feb 4, 2024Updated 2 years ago
- The open-source release of "SpikeHard: Efficiency-Driven Neuromorphic Hardware for Heterogeneous Systems-on-Chip"☆12Oct 7, 2023Updated 3 years ago
- Ubuntu 22.04 (Desktop) Boot Image (U-boot, Linux Kernel, Ubuntu RootFS) for Zynq MPSoC.☆10Jan 13, 2024Updated 2 years ago
- 中山大学电子与信息工程学院25年春,通信工程的工程应用训练课项目——智能便携式电子负载☆16Feb 8, 2026Updated 9 months ago
- ☆32Mar 13, 2025Updated last year
- Free anti-AI-slop system prompt & skill that makes ChatGPT, Claude, Gemini, Grok & Kimi write like a human. Bans AI tells (delve, tapestr…☆27Jul 1, 2026Updated 4 months ago
- A thread safe simple C++ wrapper for FFTW & MKL☆17Sep 27, 2021Updated 5 years ago
- ☆15May 7, 2025Updated last year
- Fault Injection Automatic Test Equipment☆19Nov 22, 2021Updated 4 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- For the full documentation, see https://efc-package.readthedocs.io/en/latest/☆14Apr 25, 2026Updated 6 months ago
- Android app that runs shell scripts as the root user on a rooted Android device.☆19Feb 4, 2026Updated 9 months ago
- Deno FFI bindings for SDL3 libraries with typescript wrappers.☆19May 9, 2026Updated 6 months ago
- ☆13Updated this week
- Claude skills I authored for explaining research papers step by step — main question, system model, equations, figures, results, and limi…☆71Updated this week
- Out-of-tree Rockchip RKNPU kernel module for mainline Linux (6.19+ ~ 7.0)☆22Apr 28, 2026Updated 6 months ago
- ☆13Apr 27, 2025Updated last year
- Minimum viable code for the Decodable Information Bottleneck paper. Pytorch Implementation.☆12Oct 20, 2020Updated 6 years ago
- A universal IPv4 to IPv6 virtual host reverse proxy☆12Jul 10, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- New HPC documentation using material for mkdocs☆15Nov 5, 2026Updated last week
- ContainerNetwork AutoFix (CNAF) - Automatically recreates dependent containers when master container restarts☆15Oct 17, 2025Updated last year
- Code for reproducing the results from "CrAM: A Compression-Aware Minimizer" accepted at ICLR 2023☆10Mar 1, 2023Updated 3 years ago
- Dockerized cross-compilation for the Bela platform☆14May 24, 2020Updated 6 years ago
- PMKID Attack Module for the WiFi Pineapple☆18Jul 14, 2023Updated 3 years ago
- A curated list of free courses with certifications compiled by Cloud Community. Also available at https://free-certifications.com/☆17Mar 6, 2025Updated last year
- Lightweight Neural Architecture Search for Temporal Convolutional Networks at the Edge☆10Mar 6, 2023Updated 3 years ago
- See and review any Vivado / Zynq / PYNQ project: drill-down Vivado-style diagrams and clock-domain, constraint and overlay checks for AI …☆28Nov 1, 2026Updated 2 weeks ago
- GeneralVLA: Generalizable Vision-Language-Action Models with Knowledge-Guided Trajectory Planning☆12Jun 15, 2026Updated 5 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Official implementation of ParCNetV2☆11Mar 3, 2024Updated 2 years ago
- Entire pipeline for running optimized LLM models on the RK3588S, both on the NPU (RKLLM) or the CPU (llama)☆13Jun 6, 2026Updated 5 months ago
- Official code of "Do Topological Characteristics Help in Knowledge Distillation?"☆11Aug 7, 2024Updated 2 years ago
- OpenAI-compatible API server for Rockchip NPU (RK3588/RK3576) — local LLM inference on Orange Pi with Open WebUI support☆28Aug 25, 2026Updated 2 months ago
- Code for analysis of neural populations.☆13Updated this week
- Feather is a module that enables effective sparsification of neural networks during training. This repository accompanies the paper "Feat…☆12Sep 12, 2025Updated last year
- [IROS 2025] dGeDi -- This is the official repository for the paper: Distilling 3D distinctive local descriptors for 6D pose estimation.☆15Aug 31, 2026Updated 2 months ago
Are these results useful?