LLM inference in C/C++
☆24Oct 1, 2026Updated 3 weeks ago
Alternatives and similar repositories for llama.cpp
Users that are interested in llama.cpp are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆38Jul 27, 2026Updated 2 months ago
- Replicating Jev with a local LLM☆38Sep 23, 2026Updated 3 weeks ago
- Open reproduction of TypeSafe Jev: a 150M typed decision engine (noul/choice/score in one non-autoregressive pass, calibrated confidence)…☆46Oct 6, 2026Updated 2 weeks ago
- A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative…☆12Oct 13, 2026Updated last week
- Fermion Research fork of llama.cpp: FV5/FV5B five-value ternary types for Neutrino GGUF packs (CPU + CUDA)☆14Sep 29, 2026Updated 3 weeks ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Koeiro（声彩）— 登録した声にリアルタイム変換するボイスチェンジャー（Windows / Linux / MeanVC2 + LavaSR）☆44Updated this week
- Self-hosted LiveSync-compatible backend for Obsidian with search and MCP, on Cloudflare Workers☆16Oct 13, 2026Updated last week
- ☆24Jul 6, 2026Updated 3 months ago
- ☆22May 22, 2026Updated 5 months ago
- MCP server that gives AI agents a real Chrome: Google/Bing search and JavaScript-rendered page fetches over CDP (Linux/macOS).☆69Oct 15, 2026Updated last week
- Real browser automation with local GLiNER2 inference and open weights. Work in progress. Contributions welcome.☆80Sep 18, 2026Updated last month
- Re-implemented UNIX-like kernel "zedBSD" and touch-oriented Wayland desktop "Keiland"☆41Updated this week
- Strata fork that runs GLM-5.3-Flash (320B-A18B, 157 GB) on one PC: RTX 5090 + 128 GB RAM + NVMe, ~30 tok/s chat. Fork of Niko1221/Strata …☆33Oct 13, 2026Updated last week
- Run OpenAI Codex Desktop on Linux - automated installer☆23Aug 8, 2026Updated 2 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- 蒸留蔵 — distilled long-term memory for agents: recall by meaning, writing gated by evidence, one kura per agent mode. Ships as a DeepSeek H…☆54Sep 30, 2026Updated 3 weeks ago
- Fast Rust launcher for DeepSeek Harness, with clear Claude Code/Codex migration, model setup and lightweight local tools☆91Updated this week
- A tactile M5Stack StopWatch controller for AI-assisted Vibe Coding☆148Aug 8, 2026Updated 2 months ago
- Very op bloxd.io hacks.☆31Feb 23, 2024Updated 2 years ago
- Remap the Nothing Phone Essential Key to your own actions — no root required.☆27Oct 10, 2026Updated last week
- Start Minecraft server only ONE click !☆18Updated this week
- The powerful Impact Client for MiniBlox!☆12Oct 9, 2026Updated last week
- みんなのローカルLLMベンチマーク結果をあつめるレポジトリ☆35Updated this week
- Run a 177B model (Qwen3.8-Flash-Next) on an 8 GB laptop GPU. Measured: 6.6 GiB VRAM, 47.8 GiB RAM, 34-35 tok/s. The n-gram table stays on…☆24Sep 1, 2026Updated last month
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- What actually runs on an RTX 3060 12GB, if you have any card with 12GB vram, this is for you as well. measured, with commands☆163Aug 22, 2026Updated 2 months ago
- Android向けに実装された、エンジンにmozcを採用している日本語IME☆29Sep 17, 2026Updated last month
- Nix-packaged Secure Enclave-backed SSH authentication and Git SSH signing for macOS.☆13Oct 3, 2026Updated 2 weeks ago
- ☆15Updated this week
- ☆13Aug 5, 2026Updated 2 months ago
- ☆41Aug 16, 2026Updated 2 months ago
- ☆11Nov 22, 2022Updated 3 years ago
- Code for the paper *Attention Drift: What Speculative Decoding Models Learn*.☆33May 12, 2026Updated 5 months ago
- ☆11Feb 1, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- UN Smart Maps - keep web maps open for a better world☆17Sep 6, 2026Updated last month
- DeepSeek Harness: Everything is a Plugin.☆110Updated this week
- Immutable updater of objects using JSON operation.☆11Nov 8, 2023Updated 2 years ago
- ☆11Jun 11, 2018Updated 8 years ago
- A small Node.js script that polls a website and sends a notification when there's a change. Inspired by my attempts to get a close hotel …☆13Nov 10, 2022Updated 3 years ago
- 泣き顔に見えて、可哀想...☆10Feb 16, 2023Updated 3 years ago
- DLSS 5 AIO — official NVIDIA DLSS DLLs (310.7.129) + DLSS 5 Neural Rendering runtime + DLSS5-Swapper & DLSS5-Feeder: DLSS 5 on any game (…☆39Updated this week