CPU-optimized LLM inference engine (C)
☆48Oct 18, 2026Updated this week
Alternatives and similar repositories for project-zero
Users that are interested in project-zero are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Ultra-lightweight C++ inference engine for BitMamba-2 (1.58-bit SSM). Runs 1B models on consumer CPUs at 50+ tok/s using <700MB RAM. No h…☆21Jun 2, 2026Updated 4 months ago
- Minimal, zero-dependency LLM inference in pure C11. CPU-first with NEON/AVX2 SIMD. Flash MoE (pread + LRU expert cache). TurboQuant 3-bit…☆30Sep 19, 2026Updated 3 weeks ago
- Symbio is a self fine tuning AI agent that gives power to users through seamless interaction with their machines. This flexible system ad…☆33Updated this week
- A local-first coding agent that doesn't take "done" on faith: the engine keeps the run going until the project's own tests pass, and ever…☆82Sep 22, 2026Updated 3 weeks ago
- Scripts for fbfrog-based FreeBASIC bindings☆18Mar 16, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A tiered-memory system design for workloads that don't fit in RAM: measure the working set, pin the hot tier, stream the cold tier from f…☆28Updated this week
- Local inference you can prove. A single-binary GGUF engine in C: serves, scores, and trains LoRA through the quantized weights it deploys…☆28Updated this week
- ☆46Sep 5, 2026Updated last month
- Synapse is a local-first personal memory operating system designed for AI agents. It provides durable, typed, and highly reliable long-te…☆66Updated this week
- SharpMind. A pure C# / .NET LLM engine — inference, training, and agent tooling in one solution.☆69Updated this week
- Home Assistant voice stack integration for Hermes Agent — on-device voice control, wake word → STT → LLM → TTS → HA media_player. No clou…☆79Sep 23, 2026Updated 3 weeks ago
- Qwen3.8-27b and Qwen3.6-35B-A3B local inference engine for Vulkan and Metal☆71Updated this week
- A easy-to-use token-efficient way for LLMs to navigate any website whilst looking like a human☆23Oct 6, 2026Updated last week
- Inference Llama3.2 1B/3B base/instruct models in 1 file of pure C☆24Jul 22, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- MindTrial: Evaluate and compare AI language models (LLMs) on text-based tasks with optional file/image attachments and tool use. Supports…☆21Updated this week
- ENGRAFT: write facts into an LLM's n-gram (Engram) memory table as a removable overlay: 100 facts in a 9 MB file, no weights touched, ver…☆56Sep 30, 2026Updated 2 weeks ago
- Retro DOS / Turbo Pascal 7.0 TUI frontend for the Pi coding agent☆66Sep 20, 2026Updated 3 weeks ago
- Lightweight C inference for Qwen3 GGUF. Multiturn prefix caching & batch processing.☆26Sep 1, 2025Updated last year
- Velocity Local Services: an app for running LLMs locally on Windows and Linux. Load any GGUF model and chat with web search, tools and sc…☆32Updated this week
- A static deobfuscator for JavaScript Malware☆14May 6, 2020Updated 6 years ago
- 📱 Share your phone's internet with your PC — Android → Windows reverse tethering over an encrypted WireGuard tunnel. No root, no server,…☆218Updated this week
- API gateway and reverse proxy for OpenAI APIs☆15Jul 27, 2023Updated 3 years ago
- 🎉 An emoji reactions component to use on your site☆14May 17, 2026Updated 5 months ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Private, offline AI coding agent for local Qwen models via Ollama — zero dependencies, real tools, multi-agent. Your code never leaves yo…☆18Jul 17, 2026Updated 3 months ago
- A C compiler with inferred ownership and borrow checking for Rust-style memory safety.☆26Oct 12, 2026Updated last week
- A high-performance FastAPI-based server that provides OpenAI-compatible Text-to-Speech (TTS) endpoints using the Orpheus TTS https://gith…☆31Nov 15, 2025Updated 11 months ago
- A lightweight CLI tool for RAG over local documents☆32Sep 11, 2026Updated last month
- Zero-cost LLM routing across free-tier model APIs with Bifrost, certification scripts, and agent-ready fallback chains☆55Jun 11, 2026Updated 4 months ago
- An OBS plugin to provide a filter that 9-slices sources.☆11Dec 10, 2024Updated last year
- Strata port for Tesla V100 (sm_70): Qwen3.8-Flash-Next with 262K context and MTP☆76Updated this week
- The set-and-forget LLM engine for Pascal and Volta: PXQ codec + kernels, auto-tuned per card. Ready-to-run PXQ models in MODELS.md; bench…☆85Updated this week
- ☆13Jun 27, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A fast, modern and low-memory approach to processing a big JSON☆35Jun 20, 2026Updated 3 months ago
- Frontend for Uplink☆12Apr 22, 2025Updated last year
- FreeBASIC binding creation tool☆41Mar 16, 2025Updated last year
- Fast, self-contained desktop audiobook creator with optimized local Chatterbox TTS, voice cloning, EPUB/PDF/TXT support, and optional TTS…☆34Jul 18, 2026Updated 3 months ago
- A minimal MiniCPM5-1B model inference engine built purely in Rust☆42Aug 14, 2026Updated 2 months ago
- Build Together☆28Sep 20, 2026Updated 3 weeks ago
- 文 Veyllo Agentic Framework☆27Updated this week