CPU-optimized LLM inference engine (C)
☆55Oct 30, 2026Updated last week
Alternatives and similar repositories for project-zero
Users that are interested in project-zero are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Ultra-lightweight C++ inference engine for BitMamba-2 (1.58-bit SSM). Runs 1B models on consumer CPUs at 50+ tok/s using <700MB RAM. No h…☆21Jun 2, 2026Updated 5 months ago
- Minimal, zero-dependency LLM inference in pure C11. CPU-first with NEON/AVX2 SIMD. Flash MoE (pread + LRU expert cache). TurboQuant 3-bit…☆31Sep 19, 2026Updated last month
- Pure C wrapper library to use llama.cpp with Linux and Windows as simple as possible.☆16Sep 6, 2026Updated 2 months ago
- Native desktop app & game engine in HTML/CSS/JS with 3D, Jolt physics, audio, on-device AI, GPU shaders, and in-process SMT verification …☆13Updated this week
- ☆16Oct 29, 2026Updated last week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- free ai chat bridge to your pc☆13Aug 18, 2026Updated 2 months ago
- Mic-controlled mouse clicks☆17Oct 6, 2025Updated last year
- Lightweight C inference for Qwen3 GGUF. Multiturn prefix caching & batch processing.☆27Sep 1, 2025Updated last year
- Open-source Windows AI IDE built with .NET 10 WPF, featuring a fine-tuned local AI router (1.5B), live Blender & Unity copilots, self-hea…☆18Updated this week
- A streaming Mixture-of-Experts (MoE) inference engine written in pure C, that runs models larger than your RAM on ordinary consumer hardw…☆11Oct 6, 2026Updated last month
- Scripts for fbfrog-based FreeBASIC bindings☆18Mar 16, 2025Updated last year
- Thinking blocks that open during generation: a gate decides when to think, a tree of candidate thoughts is explored, and the best one sta…☆18Oct 11, 2026Updated 3 weeks ago
- Complete setup guide for a 2-node NVIDIA DGX Spark cluster — distributed training, CUDA inference with EXO, NCCL tuning for Grace Blackwe…☆13Apr 11, 2026Updated 6 months ago
- A package for running MNN models on Dart and Flutter.☆10Oct 15, 2026Updated 3 weeks ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Local-first AI workflow orchestration for chaining models, agents, tools, and scripts into repeatable workflows.☆33Aug 10, 2026Updated 2 months ago
- Compute Where It Counts: Scaling both speed and quality with training compute☆13Sep 18, 2025Updated last year
- Validate the usable size of your local LLM cache under pressure☆12Sep 26, 2026Updated last month
- Bloat Free, Portable and Lightweight LLM Frontend (Single HTML file). With Lorebook, Web Search, Macro Engine etc.☆23Oct 30, 2026Updated last week
- MiniLM (BERT) embeddings from scratch☆22Aug 14, 2025Updated last year
- Linka is an open-source social network focused on decentralization. It allows anyone to host their own server and customize the platfor…☆25Updated this week
- Three inference engines for Llama 3: pure C for desktop systems, pure JavaScript for Node.js, and pure JavaScript for Web environments. S…☆26Oct 30, 2026Updated last week
- Skill for collaborative agent work in herdr. One agent presents, the others critique, you adjudicate.☆19Oct 14, 2026Updated 3 weeks ago
- Ekbasis: an open world model for agents. What an action will do, before it is done.☆18Oct 16, 2026Updated 3 weeks ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆23Jun 17, 2026Updated 4 months ago
- Single-file, pure CUDA C implementation for running inference on Qwen3 0.6B GGUF. No Dependencies.☆26Nov 26, 2025Updated 11 months ago
- My Implementation of Q-Sparse: All Large Language Models can be Fully Sparsely-Activated☆36Aug 14, 2024Updated 2 years ago
- ☆24Jan 22, 2025Updated last year
- Open-source System One decision engine. Typed choice / score / noul with calibrated probabilities. Self-host with Ollama or any OpenAI-co…☆22Sep 23, 2026Updated last month
- Sparse & quantized LLM training/inference/CPT/SFT/DPO☆29Oct 31, 2026Updated last week
- AI agents the Unix way☆27Jun 24, 2026Updated 4 months ago
- An emacs-inspired configuration of tmux.☆10Apr 9, 2018Updated 8 years ago
- Foundational ternary-model inference & training library — CUDA + CPU, BitNet/TQ ternary kernels☆28Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Milk-V Duo. Access to Internet throw USB RNDIS connection to host machine☆16Jan 11, 2024Updated 2 years ago
- Accelerator for MatmulFree LLM algorithm☆14Updated this week
- Software side of an LLM running inside a DRAM chip via charge-sharing PIM (BitNet b1.58 on DRAM-Bender silicon).☆22Aug 17, 2026Updated 2 months ago
- A easy-to-use token-efficient way for LLMs to navigate any website whilst looking like a human☆22Oct 6, 2026Updated last month
- Face search engine: 100% recall at 96x less memory than HNSW. Register photos, identify people from camera/video/images. AVX-512 + Rust. …☆20Jul 4, 2026Updated 4 months ago
- ☆14Apr 30, 2023Updated 3 years ago
- A framework for building your own configuration management tool☆13Oct 6, 2014Updated 12 years ago