LLM inference in C/C++
☆17Nov 8, 2026Updated last week
Alternatives and similar repositories for llama.cpp
Users that are interested in llama.cpp are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Package/Unpackage easely your DesktopBridge Apps☆16Jun 12, 2023Updated 3 years ago
- A toolkit for Weight-Space Programming / Reading☆41Updated this week
- gplay-cli: Fast, standalone Google Play APK downloader & installer in Rust (Zero-login required)☆16Aug 14, 2026Updated 3 months ago
- Structured file edits for AI agents (JSON/YAML/TOML, markdown, AST, dry-run, MCP). Not a generic filesystem MCP.☆20Updated this week
- OpenGL on flip-model swapchains via WGL_NV_DX_interop2☆19Jul 29, 2022Updated 4 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Raise your own AI partner — an open-source, local-first AI agent platform with persistent memory and evolving personality.☆20Nov 7, 2026Updated last week
- ROCmFPX llama.cpp fork for Windows 🏆 — native build, headless OpenAI-compatible server & benchmarks. Tested on AMD Strix Halo (gfx1151),…☆11Aug 15, 2026Updated 3 months ago
- Fast Qwen3.8-27B for one RTX 3090. 200k context, 100+ tok/s. Custom CUDA decode engine, OpenAI-compatible API.☆42Updated this week
- Android chat client for Hermes agents: live token streaming, tool cards, over Matrix or direct to the gateway☆14Nov 4, 2026Updated last week
- 🦞 Headless real-time Python voice assistant powered by ElevenLabs, Gemini, Mem0, MCP tools, and local wake-word detection.☆17Aug 10, 2026Updated 3 months ago
- Holos Commander, A TUI Commander for the terminal.☆18Oct 11, 2026Updated last month
- Moesif Servlet SDK for API Monitoring, Analytics, and Monetization.☆14Mar 5, 2026Updated 8 months ago
- VECTOR, a custom-built holonomic mecanum platform, as a dimOS external blueprint package☆12Oct 15, 2026Updated last month
- ☆13Oct 2, 2026Updated last month
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A local-first AI companion that keeps watching while nobody is talking, so it can tell you what you were doing five minutes ago. Runs ent…☆10Jul 29, 2026Updated 3 months ago
- This is a source dump for our failed startup [Credport](http://www.credport.org).☆14Jun 6, 2014Updated 12 years ago
- Open TTS is a local-first text-to-speech studio with WebGPU browser inference and Electron runtimes powered by Rust — open elevenreader.☆11Updated this week
- A WKWebview Wrapper for @levelsio's flight simulator☆10Sep 19, 2026Updated last month
- ProCurrency Official Source Code☆13May 9, 2019Updated 7 years ago
- ☆14Aug 13, 2026Updated 3 months ago
- Dynamic-island notch for Omarchy showing live Claude Code (and Grok Bot) agents — animated faces, alerts, ask Claude from the notch☆16Oct 3, 2026Updated last month
- 代码生成器☆10Jan 26, 2014Updated 12 years ago
- ☆10Dec 15, 2024Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Agentic Development Environment - local - in browser☆12Aug 10, 2026Updated 3 months ago
- A curated list of awesome AI tools for creating, editing, and enhancing videos, animations, and multimedia content.☆13Apr 19, 2025Updated last year
- Clean reproducible benchmark suite for the self-hosted cascade RC (ARC-AGI-2, HMMT-2026, HLE, MMMU-Pro, SWE-Bench Pro, Terminal-Bench 2.1…☆13Nov 2, 2026Updated 2 weeks ago
- Mirrors a lerobot-teleoperate leader/follower session into Isaac Sim in real time over UDP — teleoperate the real arm, watch it move li…☆16Aug 2, 2026Updated 3 months ago
- Claude Code skill for capturing and codifying learnings before session ends / context lost☆24Nov 4, 2026Updated last week
- ☆11Oct 11, 2018Updated 8 years ago
- GB10 NVFP4 native MTP reproducibility pack for Qwen3.6-35B-A3B☆13May 19, 2026Updated 5 months ago
- Set a specific expiration date (e.g. 2026-12-31) for a PMPro membership level or discount code. This expiration date will override any ex…☆10Sep 29, 2026Updated last month
- Uncensored Qwen3.8-27B Ultimate - BF16 master + NVFP4-MIXED deploy. QuickStarts for DGX Spark (one Dynamic DFlash lattice seat @ util 0.8…☆21Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Validated vLLM recipe: Qwen3.8-27B-NVFP4 at full 262,144-token context on a single RTX 5090, GPU-only (no CPU offload).☆16Aug 20, 2026Updated 2 months ago
- ☆14Aug 1, 2025Updated last year
- Omaxian is a port of Omarchy shell for Debian-based systems + X11/XLibre + i3. Same bar, themes, launcher, and omarchy-* commands — no Wa…☆23Updated this week
- ☆13Nov 10, 2026Updated last week
- Persys server. All services you need to run Persys locally.☆18Feb 5, 2025Updated last year
- Navigation stack for AgileX Scout Mini robot.☆13Oct 1, 2026Updated last month
- Free 3D assets for AI agents: search ~36,000 free (mostly CC0) models, materials and HDRIs with real-world sizes, as an MCP server☆53Updated this week
Are these results useful?