LLM inference in C/C++
☆57Sep 26, 2026Updated 3 weeks ago
Alternatives and similar repositories for llama.cpp
Users that are interested in llama.cpp are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- AI-run shop: Medusa v2 + Next.js + Payload CMS operated by Fox, the built-in AI assistant. Open-source free edition of Vulpy Commerce.☆122Sep 16, 2026Updated last month
- The $0 AI Empire Playbook — 180 scheduled jobs, 43 free LLM lanes, and the failure classes that almost killed it. Free tiers only.☆101Sep 22, 2026Updated 3 weeks ago
- Sample project to build and run Turso's SQLite fork on iOS and use vector search functionality on device☆15Jul 26, 2024Updated 2 years ago
- DeepSeek-V4-Flash-0731 284B inference in ~25 GB of RAM / Qwen3.8-Next-Flash inference in ~15 GB of RAM on any M-series MacBook☆148Updated this week
- Durable Pi playground and agent network: persistent, multi-device durable agents with web and terminal clients☆186Oct 11, 2026Updated last week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Portable optimized ROCm and Qwen3.8-27B setup for AMD Strix Halo☆83Sep 16, 2026Updated last month
- Set or toggle multiple monitor's input sources via DDC/CI☆13Mar 1, 2019Updated 7 years ago
- Checkpoint 401 Forward Auth Security Server.☆17Oct 6, 2026Updated last week
- ☆10Jul 14, 2025Updated last year
- Defines and applies a controlled Windows 11 LTSC 2024 baseline through a staged, deterministic setup pipeline with predictable behavior a…☆50Sep 24, 2026Updated 3 weeks ago
- Haiku native PowerPC and Hobbit BeBox Emulator☆31Updated this week
- ☆19Oct 18, 2025Updated last year
- Embed the nu engine in your rust application☆12Mar 2, 2024Updated 2 years ago
- Information-dense, coverage-guided binary fuzzer☆45Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A curated list of free construction, landscaping, and home improvement calculators. Estimate materials, quantities, and costs for conc…☆17Feb 18, 2026Updated 8 months ago
- Atlas Inference is a dependency free lightweight inference engine meant to run LLMs on YOUR compute seamlessly. Supports GB10 and Strix H…☆34Updated this week
- Lightweight Docker image for launching multiple MCP servers via MCPO with unified OpenAPI access☆40May 26, 2025Updated last year
- Port of Facebook's LLaMA model in C/C++☆15Oct 10, 2026Updated last week
- Run Cloudflare's clef-flash decision model locally on your webcam☆35Oct 1, 2026Updated 2 weeks ago
- Infernet: A Peer-to-Peer Distributed GPU Inference Protocol☆31Updated this week
- A small in-memory key value database for rust☆14Jun 8, 2023Updated 3 years ago
- combining glicol language/audio engine with tidal pattern and strudel js☆16Jun 11, 2022Updated 4 years ago
- Publicly available Container Images☆14Aug 23, 2026Updated last month
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Sandbox for running AI coding agents autonomously: isolated, network-restricted, host-safe☆63Updated this week
- Coding agent where a 0.8B decision model works alongside Qwen 3.8-27B: Jeff takes the routine steps itself and decides when Qwen should t…☆27Oct 7, 2026Updated last week
- Step-by-step guide to set up Sparky, the HackRF radio assistant☆71Aug 9, 2026Updated 2 months ago
- Local inference engine for Qwen3.8-Flash-Next on NVIDIA Blackwell☆71Updated this week
- Useful template literal tag for create html strings in ES2015+☆13Jun 29, 2026Updated 3 months ago
- Configuration, benchmarking scripts, and raw data for serverless cold start benchmarks.☆17Jul 24, 2024Updated 2 years ago
- Scrollable Index of all 43252003274489856000 Rubik's Cube states☆43Aug 11, 2026Updated 2 months ago
- Browser playground and game for llama-server's /v1/decision (Jev-style parallel constrained decisions)☆26Sep 19, 2026Updated 3 weeks ago
- 🦉 OpenCode skill — error reflection & 5-Why root-cause learning agent☆17Sep 1, 2026Updated last month
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- RxDB + SvelteKit☆14Jun 21, 2021Updated 5 years ago
- A terminal where one Claude Code session supervises the AI agents in your other tabs: which is stuck, which is done, which is still runni…☆19Updated this week
- Superpowers skill port to Reasonix coding harness.☆102Updated this week
- Share your content of clipboard between 2 computers!☆10Apr 3, 2018Updated 8 years ago
- Strix Halo (gfx1151) + XDNA2 NPU inference fork: Qwen3.8 Flash-Next UD-IQ4_XS with MTP. About 2,000 tok/s prefill (GPU + NPU, 2,013 at 8K…☆48Updated this week
- Ternary Bonsai 2 27B MLX inference speedup benchmark engine☆34Oct 10, 2026Updated last week
- Support and Resistance Lines is a robust support/resistance indicator based on ATR and Fractals.☆14Apr 10, 2026Updated 6 months ago