LLM inference in C/C++
☆22Oct 25, 2026Updated last week
Alternatives and similar repositories for llama.cpp
Users that are interested in llama.cpp are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Stable, high-throughput inference server for multi-GPU NVIDIA V100 (SM70): Qwen3.8 Flash-Next with AWQ / NVFP4, multimodal input, CPU/dis…☆36Updated this week
- ☆11Apr 22, 2013Updated 13 years ago
- Demonstration of integration between React and TypeScript/Flow☆13Jan 29, 2015Updated 11 years ago
- SGLang for cool dudes using V100☆82Updated this week
- Unofficial C# SDK for ZR04RN CCTV☆13Jun 8, 2023Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Self-hosted, Markdown-first agent workspace for knowledge work.☆22Updated this week
- The set-and-forget LLM engine for Pascal and Volta: PXQ codec + kernels, auto-tuned per card. Ready-to-run PXQ models in MODELS.md; bench…☆108Updated this week
- Benchmarks and notes for running modern LLMs with vLLM on 8x Tesla V100-32GB in 2026.☆23Jul 10, 2026Updated 3 months ago
- Strata port for Tesla V100 (sm_70): Qwen3.8-Flash-Next with 262K context and MTP☆119Updated this week
- Stupid EU legal compliance in one (long) line of JavaScript☆17Sep 25, 2014Updated 12 years ago
- Sol-Attn (arXiv 2607.24027) sparse acceleration for MiniMax H3 on V100 — single-node ComfyUI plugin (embedded FP16Safe + keep-or-drop ker…☆34Aug 29, 2026Updated 2 months ago
- Original Satoshi paper ("Bitcoin White Paper") in various formats.☆10Oct 18, 2025Updated last year
- A few files to quickly bring up a MAS Manage instance on OCP Local☆27Nov 14, 2024Updated last year
- Superseded by github.com/poisonxa16/pxa — PXA, the set-and-forget engine for Pascal and Volta☆24Sep 8, 2026Updated last month
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Online galaxy conquest turn-based game☆19Aug 29, 2026Updated 2 months ago
- Local AI model manager☆16May 21, 2026Updated 5 months ago
- Pre-configured NixOS that automates maintenance tasks☆15Updated this week
- High-performance single-GPU inference for selected model checkpoints and GPUs.☆256Sep 14, 2026Updated last month
- Python library for Telize JSON IP and GeoIP REST API☆12Nov 26, 2015Updated 10 years ago
- There you can see all my edited Windows 10 versions. If I will edit the Windows I will show how, until now you ll see the WinReducerEX100…☆11Jul 2, 2020Updated 6 years ago
- Mixed-precision acceleration patch for MiniMax H3 inference on NVIDIA V100☆40Sep 6, 2026Updated last month
- Django Productivity Tools☆13May 13, 2011Updated 15 years ago
- ☆12Mar 17, 2015Updated 11 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Scripts to build openrisc toolchain and bootable filesystem☆12Sep 15, 2014Updated 12 years ago
- Qwen 3.8 Next Flash toolbox utilizing pwilkin's strix-halo llama.cpp fork☆13Sep 16, 2026Updated last month
- ☆13Mar 17, 2023Updated 3 years ago
- A Forth J1 emulator in C☆14Nov 25, 2025Updated 11 months ago
- ☆12Jul 17, 2020Updated 6 years ago
- Downhill Mayhem — a free fan-made browser tribute to Downhill Domination (PS2, 2003).☆13Jul 28, 2026Updated 3 months ago
- Chrome Extention to Recover streamed PDFs from web tabs☆14Jul 24, 2026Updated 3 months ago
- Eval framework that ranks agentic coding frameworks (Superpowers, Compound Engineering, Agent Skills, GSD) by having each build the same …☆15Jul 8, 2026Updated 3 months ago
- User Script for http://workflowy.com that adds some extra features.☆12Oct 22, 2017Updated 9 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Generalized app for two-step verification.☆12Feb 28, 2024Updated 2 years ago
- CamelForth in C for RP2040 Raspberry Pi Pico. A Forth by Dr Brad Rodriguez - ported to RP2040 by wa1tnr - Forth interpreter is on the RP2…☆12Oct 27, 2021Updated 5 years ago
- [Unmaintained] A select component heavily inspired by Harvest's Chosen☆18Nov 1, 2013Updated 13 years ago
- MLX benchmark: Gemma 4 + Qwen 3.5 on Apple Silicon with TurboQuant KV cache☆22Apr 6, 2026Updated 6 months ago
- OpenClaw Gateway 快速診斷與修復工具包 - 一鍵診斷 + 一鍵修復☆19Mar 6, 2026Updated 7 months ago
- every entropy measure for time series data, in one consistent API☆18Sep 25, 2026Updated last month
- LINE Unofficial repo☆13Dec 20, 2019Updated 6 years ago