Guide I wrote mostly for myself on how to run mlc-llm on the Orange Pi 5 Pro
☆25Aug 15, 2025Updated last year
Alternatives and similar repositories for Orange-PI-5-Pro-MLC-LLM
Users that are interested in Orange-PI-5-Pro-MLC-LLM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Run Large Language Models on RK3588 with GPU-acceleration☆132Aug 16, 2023Updated 3 years ago
- ☆39Aug 4, 2026Updated 3 months ago
- Quick and dirty benchmarking tool to measure the performance of RK3588 NPU.☆12Feb 23, 2024Updated 2 years ago
- A simple platform-agnostic chaos monkey☆12May 9, 2017Updated 9 years ago
- rknn rust ffi binding☆20Feb 26, 2026Updated 8 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- top-like script for rockhip NPUs on linux☆69Nov 6, 2025Updated last year
- ☆10May 8, 2025Updated last year
- A Text based UI for managing FGA Tuples☆13Mar 16, 2024Updated 2 years ago
- An automated pipeline to convert e-books into beautifully illustrated scenes using local AI backends ComfyUI and SD Forge.☆11Jan 9, 2026Updated 10 months ago
- Fast and Stable Color Balancing for Images and Augmented Reality☆16Dec 19, 2015Updated 10 years ago
- Easier usage of LLMs in Rockchip's NPU on SBCs like Orange Pi 5 and Radxa Rock 5 series☆200Aug 3, 2025Updated last year
- A quick and optimized solution to manage llama based gguf quantized models, download gguf files, retreive messege formatting, add more mo…☆15Jan 13, 2024Updated 2 years ago
- Easy installation and usage of Rockchip's NPUs found in RK3588 and similar SoCs☆255Aug 3, 2025Updated last year
- Exploring synthetic aperture radar imaging by building real hardware☆13Mar 2, 2022Updated 4 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Script used to decode serial data stream of Contec KT88-2400 EEG amplifier and to stream it to the local network via LSL☆14Sep 10, 2025Updated last year
- A Sublime package for the just command runner☆17Apr 12, 2026Updated 7 months ago
- A tiny Lua based pixel/chiptune engine☆12Nov 22, 2017Updated 9 years ago
- Bionic Reading for the Terminal☆13Aug 25, 2022Updated 4 years ago
- 🔧 🎨 HelMA - Haskellish Esoteric Little Minimal Automaton for Esoteric Languages implemented in Haskell☆16Oct 15, 2026Updated last month
- Userspace driver, matmul, and on-NPU op library for Rockchip NPUs (RK3588 & Subset on RK3576) via the mainline rocket DRM-accel driver☆25Updated this week
- Hardware reference and research notes for the RK3588 NPU and its regcmd interface☆34Nov 14, 2026Updated last week
- Extract statistics from Wikipedia Dump files.☆26Aug 2, 2021Updated 5 years ago
- Make your LevelUP get(), put() and del() accept multiples keys & values.☆11Apr 11, 2013Updated 13 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A CNC-fabricated mallet for use during assembly of the Wren chassis☆11Mar 14, 2022Updated 4 years ago
- A Rust-based, OpenAI-style API server for large language models (LLMs)☆25Updated this week
- CAM and control machine from Chrome, path from Inkscape directly using extension☆14Dec 12, 2022Updated 3 years ago
- ☆14Dec 23, 2023Updated 2 years ago
- Drop-in ggml backend for Rockchip NPUs: offloads llama.cpp/whisper.cpp prefill to the RK3588 NPU☆28Nov 14, 2026Updated last week
- Tiny library to process live audio input in the browser☆14Jun 23, 2014Updated 12 years ago
- A blazingly fast rust-based bionic reader for blazingly fast reading within a terminal console 🦀☆25Nov 13, 2023Updated 3 years ago
- A Python-based chat application utilizing a Local LLM to generate complex thought chains for various use cases such as product developmen…☆20Feb 18, 2026Updated 9 months ago
- A JavaScript playground/sandbox for learning, testing and prototyping☆12Aug 18, 2017Updated 9 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- A framework for spectrum-based fault localization (SBFL)☆13Jun 8, 2025Updated last year
- A tiny CRDT implementation in Javascript.☆12Jun 1, 2022Updated 4 years ago
- aracnaHardware☆14Mar 5, 2015Updated 11 years ago
- Tiny, composable Atomic CSS engine☆13Apr 1, 2022Updated 4 years ago
- A web-app to help you build grid-layouts for your web-app☆12Mar 8, 2021Updated 5 years ago
- ActivityStreams 2.0 vocabulary in machine-readable form, scraped using TypeScript + cheerio☆10Sep 12, 2018Updated 8 years ago
- CGO bindings to RKNN-Toolkit2 to perform Inferencing in Go on Rockchip NPU☆198May 25, 2026Updated 5 months ago
Are these results useful?