llama.cpp with adaptive speculative decoding (--spec-draft-adaptive) and a Vulkan backend tuned for AMD Strix Halo. 4.7x on structured output, 1.9x mainline prefill on MoE.
☆119Sep 19, 2026Updated last month
Alternatives and similar repositories for llama.cpp
Users that are interested in llama.cpp are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ROCmFPX llama.cpp fork for Windows 🏆 — native build, headless OpenAI-compatible server & benchmarks. Tested on AMD Strix Halo (gfx1151),…☆11Aug 15, 2026Updated 2 months ago
- Java implementation of MQTT 5.0 compatible broker based on RLib library.☆18Sep 28, 2026Updated last month
- Ezviz SDK，功能更强大的开发套件，可以实现预览、回放、配网、对讲、设备控制、oAuth授权等功能☆14Oct 13, 2026Updated 3 weeks ago
- Helper scripts for dealing with various Substrate tasks.☆13Mar 6, 2026Updated 8 months ago
- OmaSeek: the Omarchy spirit and aesthetic. Now in DeepSeek Harness☆19Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Эксперимент с автономными агентами на базе claude code☆28Sep 8, 2026Updated last month
- A Substrate frame pallet for account-level permissioning using account whitelisting.☆10Feb 6, 2023Updated 3 years ago
- Assorted agent skills☆23Updated this week
- Follow-up project to shows how to use complex data structures between Unity and Rust.☆13May 6, 2021Updated 5 years ago
- LLM inference in C/C++☆27Oct 8, 2026Updated 3 weeks ago
- DeepSeek Harness 核心的便携引擎 + Termux 友好的终端编程 Agent CLI（pi 壳 + DSH 引擎，零运行时依赖，359MB→7.6MB 单文件）☆13Aug 16, 2026Updated 2 months ago
- Polkadot SDK best practices, presented as a mdbook.☆13Apr 11, 2025Updated last year
- Substrate Contract SDK for Python As a part of Himalia☆12Dec 6, 2021Updated 4 years ago
- Qwen 3.8 27B ROCmFP4 on AMD Strix Halo (Ryzen AI Max+ 395). Up to 36 tok/s via MTP Speculation, TurboQuant & Mesa RADV Wave64.☆266Sep 7, 2026Updated last month
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Transmission add-on for Home Assistant☆16Sep 21, 2026Updated last month
- 获取微信账号信息(昵称/账号/手机/邮箱/数据库密钥/wxid)；PC微信数据库读取、解密脚本；聊天记录查看工具；聊天记录导出为html(包含语音图片)。支持多账户信息获取，支持所有微信版本。☆14Oct 16, 2025Updated last year
- 一个仿 Bob 的截屏+翻译二合一工具，支持 macOS 和 Windows☆15Oct 30, 2026Updated last week
- Substrate-deps, a command line tool for managing Parity Substrate runtime module dependencies.☆13Mar 12, 2020Updated 6 years ago
- Academic text processing pipeline with GUI flow editor☆141Sep 13, 2026Updated last month
- Athena Algorithms is a collection of algorithm solutions with multi-language implementations, organized by problem and by category.☆38Sep 27, 2026Updated last month
- Simple temperature converter written in Iron Python and using WPF☆16Jul 23, 2019Updated 7 years ago
- ☆12Oct 30, 2023Updated 3 years ago
- ROCmFPX Family for AMD Hardware and Processors. More quants and special agent quants☆14Sep 19, 2026Updated last month
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- The Litentry pallets.☆12Dec 27, 2021Updated 4 years ago
- ☆32Oct 22, 2026Updated 2 weeks ago
- Example .NET Core project with plugin architecture & dependency injection for plugins☆12Jul 7, 2020Updated 6 years ago
- LLM inference in C/C++☆256Updated this week
- Qwen3.8-27B on one laptop CPU: up to 2.52 token/s, 8 GB tested, no runtime accuracy loss. Native OpenAI-compatible API with function tool…☆23Sep 9, 2026Updated last month
- hi3798mv3dmm_hi3798mv300 4.4.35_ecoo_83080368 CH341☆27Oct 2, 2023Updated 3 years ago
- Optimized Codex CLI distribution for Linux, Android/Termux, and macOS with Vivling and loop workflow support.☆17Updated this week
- A lightweight proxy server that translates between OpenAI **Chat Completions API** and **Responses API** formats — enabling any Chat Comp…☆14May 17, 2026Updated 5 months ago
- Manages Shrew Soft VPN client and connection. Reconnects when the connection is dropped.☆15Jul 12, 2018Updated 8 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- LLM inference in C/C++☆43Updated this week
- List of awesome reverse engineering resources☆11Nov 19, 2017Updated 8 years ago
- ☆29Apr 7, 2021Updated 5 years ago
- An extensible arbitrage bot for trading against valence auctions, Astroport and Osmosis☆10Oct 18, 2024Updated 2 years ago
- Fiddler Importer for Chromium NetLog .json files☆22Apr 10, 2025Updated last year
- Template node for a frontier (EVM) based parachain.☆15Oct 20, 2026Updated 2 weeks ago
- A Python command-line utility to convert enex-files to Markdown☆16Jul 9, 2023Updated 3 years ago