LLM inference in C/C++
☆28Oct 20, 2026Updated this week
Alternatives and similar repositories for llama.cpp
Users that are interested in llama.cpp are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A set of performant RDNA/HIP patches against llama.cpp focusing on high speed inferencing with numerics assurance☆201Updated this week
- Differential-KV (DKV) is a sparse KV-cache inference runtime designed for high-efficiency, memory-bounded long-context Large Language Mod…☆21Updated this week
- SGLang Docker image for AMD Strix Halo (gfx1151 / Radeon 8060S)☆41Sep 17, 2026Updated last month
- vLLM + Qwen3.6-27B (BF16) OpenAI-compatible inference server on AMD Strix Halo (Ryzen AI Max+ 395, gfx1151). Vision input, 256K context, …☆18Apr 26, 2026Updated 5 months ago
- Turn a Snapdragon phone into a Linux gaming handheld. Mainline Linux, Steam in Game Mode, Windows games through Proton ARM64. No Android.☆24Oct 10, 2026Updated last week
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆23Updated this week
- Anusaaraka is an English-Hindi language accessing software. It is a machine translation tool with insights from Panini's Ashtadhyayi (Gra…☆10Aug 24, 2020Updated 6 years ago
- An RDNA4 R9700 AI Pro ComfyUI patch for MiniMax H3 to speed up video generation.☆34Aug 8, 2026Updated 2 months ago
- A constitution generator for autonomous, agent-run projects: an interview-driven meta system prompt (and installable skill) that scaffold…☆37Sep 1, 2026Updated last month
- ☆85Updated this week
- Minimal Perfect Hash-Table CL Implementation☆16Jan 31, 2018Updated 8 years ago
- Common Lisp implementation of delta debugging☆13Jun 26, 2018Updated 8 years ago
- From the world's largest port to the nation's first freeways to pioneering aqueducts, California's history has been defined by visionary …☆13Sep 17, 2026Updated last month
- A modern, local-first game library and launcher for Linux and Windows. Organize and launch your collection with an open-source alternativ…☆31Updated this week
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- LLM-first Three.js WebGPU scene and animation authoring with a persistent native viewport and typed MCP editing☆24Sep 4, 2026Updated last month
- ☆13Jan 12, 2026Updated 9 months ago
- LLM inference in C/C++☆15May 7, 2026Updated 5 months ago
- Spam-filtered, open-data registry of DeepSeek Harness (dsh) plugins, bundles, and skills.☆23Updated this week
- Build real-time multimodal AI applications 🤖🎙️📹☆10Sep 16, 2026Updated last month
- MOVED to https://tildegit.org/contrapunctus/chronometrist☆11May 10, 2021Updated 5 years ago
- TurboQuant KV cache compression for llama.cpp — HIP/ROCm port for AMD RDNA3 (gfx1100)☆54Apr 26, 2026Updated 5 months ago
- decentralized llm sharing☆28Jul 31, 2026Updated 2 months ago
- Repo for providing the instructions to generate a new ISO or the installations scripts of DappNode☆10Oct 30, 2021Updated 4 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- 20 built-in AI personas for OpenClaw — switch from Dev to Chef Marco to Dr. Med on demand. Coding, writing, cooking, medical and more.☆13Aug 31, 2026Updated last month
- MCP server that shrinks logs, JSON, docs and web pages before your AI reads them. Offline, deterministic, ~3ms, no API key. 66% fewer tok…☆25Updated this week
- Qwen 3.8 27B ROCmFP4 on AMD Strix Halo (Ryzen AI Max+ 395). Up to 36 tok/s via MTP Speculation, TurboQuant & Mesa RADV Wave64.☆258Sep 7, 2026Updated last month
- Winning Qwen and DeepSeek setups for AMD Strix Halo: pinned Ansible recipes and matched benchmarks on a 128 GiB Ryzen AI Max+ 395 / Radeo…☆22Oct 6, 2026Updated 2 weeks ago
- Math is a mathematical library that implements some algorithms: of linear algebra; statistics; finding approximating polynomials on Commo…☆14Apr 2, 2026Updated 6 months ago
- LLM inference in C/C++☆42Updated this week
- Official implementation of the paper "HermesBDD: A Multi-Core and Multi-Platform Binary Decision Diagram Package" accepted @ DDECS 2023.☆15Jul 11, 2025Updated last year
- The fastest way to run Qwen3.8-Flash-Next on Strix Halo (gfx1151)☆1,018Updated this week
- Run a 177B model (Qwen3.8-Flash-Next) on an 8 GB laptop GPU. Measured: 6.6 GiB VRAM, 47.8 GiB RAM, 34-35 tok/s. The n-gram table stays on…☆24Sep 1, 2026Updated last month
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Propositional Dynamic Logic in Lean 4, showing Craig Interpolation via Tableau☆16Updated this week
- A Common Lisp client library for the IPFS API☆14Nov 27, 2017Updated 8 years ago
- MCP server for Tailscale, backed by the tailscale CLI and control-plane REST API☆14Oct 10, 2026Updated last week
- ☆16Nov 12, 2024Updated last year
- AI-native, source-available (PolyForm Perimeter) game-dev toolkit: bforge — deterministic headless-Blender asset forge for AI agents (138…☆30Sep 14, 2026Updated last month
- Official AMD catalog of AI agent skills. Empower your AI agents with AMD's optimized SW stack.☆424Updated this week
- A versatile mail library for common lisp (active fork of neonsquare/mel-base)☆14Aug 22, 2026Updated last month