Fermion Research fork of llama.cpp: FV5/FV5B five-value ternary types for Neutrino GGUF packs (CPU + CUDA)
☆14Sep 29, 2026Updated 3 weeks ago
Alternatives and similar repositories for llama.cpp
Users that are interested in llama.cpp are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative…☆12Oct 13, 2026Updated last week
- LLM inference in C/C++☆24Oct 1, 2026Updated 3 weeks ago
- Donkey, often known by its file name DONKEY.BAS, is a computer game written in 1981 by Microsoft co-founder Bill Gates and Neil Konzen. T…☆15Aug 13, 2026Updated 2 months ago
- ☆22May 22, 2026Updated 5 months ago
- Fully local voice-and-vision assistant for Reachy Mini Lite on NVIDIA Jetson Orin Nano☆35Oct 6, 2026Updated 2 weeks ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- 跨平台桌面语音工作台：在任意应用里说、译、听 / A cross-platform voice workspace for your desktop: dictate, translate, and listen in any app☆19Updated this week
- One-menu RTX 5090 setup for non-Swift Huihui Qwen3.8-27B NVFP4 with Cinference, MTP-10 and K8V4.☆34Sep 22, 2026Updated last month
- Talk about Cartesia Ink STT using Cartesia Ink STT☆14Jun 10, 2025Updated last year
- AI GTM Engine for cold outbound on autopilot☆61Oct 8, 2026Updated 2 weeks ago
- ☆13Aug 5, 2026Updated 2 months ago
- ☆41Aug 16, 2026Updated 2 months ago
- Code for the paper *Attention Drift: What Speculative Decoding Models Learn*.☆33May 12, 2026Updated 5 months ago
- Multiplayer version of the great game GranTurismo 2☆28Sep 13, 2026Updated last month
- Implementation of EIP-2678☆13Sep 25, 2026Updated 3 weeks ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A small Node.js script that polls a website and sends a notification when there's a change. Inspired by my attempts to get a close hotel …☆13Nov 10, 2022Updated 3 years ago
- What actually runs on an RTX 3060 12GB, if you have any card with 12GB vram, this is for you as well. measured, with commands☆163Aug 22, 2026Updated 2 months ago
- Game ports for the Miyoo Mini, Mini Plus, and Mini Flip☆50Updated this week
- Fork of Android 16 Terminal with dependency on AVF removed☆14Dec 9, 2025Updated 10 months ago
- WETH Implementation in Vyper + gas comparisons to WETH9 and WETH10☆16Mar 15, 2024Updated 2 years ago
- Raw speed benchmark traces: Qwen3.8-27B on 4x RTX 3090. llama.cpp GGUF sweeps + 288-point vLLM vs SGLang, NVFP4 vs FP8 matrix.☆13Sep 28, 2026Updated 3 weeks ago
- ☆15Dec 27, 2023Updated 2 years ago
- ☆16Jul 21, 2026Updated 3 months ago
- Foundry is a blazing fast, portable and modular toolkit for Ethereum application development written in Rust.☆10Oct 21, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Run oversized sparse MoE GGUF models with bounded NVMe-to-RAM-to-VRAM caching, native multi-GPU planning, and a Linux desktop Studio.☆20Oct 12, 2026Updated last week
- A voice assistant for your on-screen content☆20Sep 11, 2026Updated last month
- AWS SAM Lambda and SQS demo☆11Jun 27, 2018Updated 8 years ago
- On device Firewall for Coding and Personal Agents☆1,632Sep 5, 2026Updated last month
- Easily run LLMs locally using llama.cpp directly, without overhead.☆21Aug 15, 2026Updated 2 months ago
- Simple benchmarks for XML parsing libraries☆11Apr 28, 2018Updated 8 years ago
- Get file information based on file signature☆16Sep 11, 2015Updated 11 years ago
- DeepSeek Harness Mobile 是 DeepSeek Harness 的 Android 原生应用，将原本仅支持 PC 浏览器的 AI Agent 框架完整迁移至移动端。采用 Kotlin + Jetpack Compose 开发，内置 Node.js AR…☆28Aug 17, 2026Updated 2 months ago
- Persistent AI memory for Claude Code, OpenClaw, and any MCP-compatible agent. BM25F + vector hybrid, governance-aware, local-first, zero-…☆18Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Bundle a CommonJS module and its dependencies into a single ES module☆12Dec 26, 2018Updated 7 years ago
- ☆13Aug 17, 2022Updated 4 years ago
- 🔥 Massive archive of real AI system prompts and tool configs across major coding assistants — prompt intelligence in one place.☆12Feb 24, 2026Updated 7 months ago
- Zero Token - 本地免费 LLM API 服务，通过浏览器自动化调用商业大模型☆17Mar 30, 2026Updated 6 months ago
- React AWS S3 upload using Amplify and Material UI☆10Jan 5, 2023Updated 3 years ago
- Per-commit evidence records for agent-written code. Captures what the agent tried, what verified it, and what nobody reviewed☆23Sep 15, 2026Updated last month
- Codex CLI tweaked for Android/Termux (self-update + build version)☆15Updated this week