LLM inference in C/C++
☆15Aug 27, 2026Updated last month
Alternatives and similar repositories for llama.cpp
Users that are interested in llama.cpp are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Fermion Research fork of llama.cpp: FV5/FV5B five-value ternary types for Neutrino GGUF packs (CPU + CUDA)☆14Sep 29, 2026Updated 3 weeks ago
- The text editor that thinks like a code editor.☆19Updated this week
- TxtAIEditor - A Premium WinUI 3 Desktop Text Editor with an Integrated AI Agent☆16Updated this week
- ☆19Oct 13, 2026Updated last week
- ☆28Aug 15, 2026Updated 2 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- One-menu RTX 5090 setup for non-Swift Huihui Qwen3.8-27B NVFP4 with Cinference, MTP-10 and K8V4.☆34Sep 22, 2026Updated last month
- A ComfyUI extension allowing for the interrogation of booru tags from images.☆24Oct 7, 2026Updated 2 weeks ago
- Singing voice conversion built on LeapSinger's harmonic excitation and rectified flow: content + F0 + loudness -> mel -> NHVSing. Quality…☆22Oct 1, 2026Updated 3 weeks ago
- ☆14Nov 27, 2025Updated 10 months ago
- ☆27Jul 13, 2026Updated 3 months ago
- Structured assembly rewriting library/mod for RW☆21Feb 7, 2026Updated 8 months ago
- A diary application that is build with React Native and Expo.☆13Feb 14, 2025Updated last year
- Run a 177B model (Qwen3.8-Flash-Next) on an 8 GB laptop GPU. Measured: 6.6 GiB VRAM, 47.8 GiB RAM, 34-35 tok/s. The n-gram table stays on…☆24Sep 1, 2026Updated last month
- 现代化订阅转换工具 — Go 重写的 subconverter，支持 Hysteria2/TUIC/VLESS Reality 等新协议，输出 Clash.Meta、singbox、surge、shadowrocket、quanx、loon、v2ray等target☆29Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- What actually runs on an RTX 3060 12GB, if you have any card with 12GB vram, this is for you as well. measured, with commands☆163Aug 22, 2026Updated 2 months ago
- ☆57Sep 27, 2026Updated 3 weeks ago
- Automatically updated and decrypted client-side data from Blue Archive game, providing character stats, equipment data, and more for fan …☆24Updated this week
- ☆37Updated this week
- Jev for Computer Use☆20Sep 28, 2026Updated 3 weeks ago
- Reverse-engineered system prompts from Claude (claude.ai) and Claude Code CLI, validated against Anthropic's officially published prompts…☆18Feb 15, 2026Updated 8 months ago
- ☆17Oct 15, 2026Updated last week
- Easily run LLMs locally using llama.cpp directly, without overhead.☆21Aug 15, 2026Updated 2 months ago
- A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative…☆12Oct 13, 2026Updated last week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ComfyUI workflows for MiniMax H3 (Ref2VA / FL2VA / VideoRef / Pose Control) at Full HD on 12GB VRAM.☆27Oct 15, 2026Updated last week
- A bare-bones GUI application for the local inference engine, llama.cpp. Built-in TPE optimiser to find the best flags for your system☆18Oct 15, 2026Updated last week
- Singing-voice synthesis & Singing-voice Conversion☆39Sep 21, 2026Updated last month
- Pawchive Downloader is a modern desktop media grabber for Pawchive, Kemono, Coomer, and Cum.st. It features multi-threaded downloads, bui…☆60Updated this week
- Official repository for: Simultaneous Music Separation and Generation Using Multi-Track Latent Diffusion Models☆19Nov 21, 2025Updated 11 months ago
- ComfyUI Nodes☆21May 12, 2026Updated 5 months ago
- Qwen3.8-27B EXL3 (4.00 bpw) + DFlash2 speculative decoding for ExLlamaV3, validated at 262k context on a 24 GB RTX 3090☆25Sep 20, 2026Updated last month
- Tells you if you are impacted by the supply chain attack.☆24May 13, 2026Updated 5 months ago
- ☆14Sep 30, 2026Updated 3 weeks ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆15Oct 16, 2026Updated last week
- Official codebase for the paper "How to Guide Your Flow: Few-Step Alignment via Flow Map Reward Guidance" (ICML 2026).☆19Jun 10, 2026Updated 4 months ago
- KeyHunter is a powerful tool designed to discover API key leaks from subdomains and archived URLs☆22Aug 1, 2026Updated 2 months ago
- Cataclysm Dark Days Ahead Co-op fork☆34Updated this week
- A curated list of open-source Small Language Models (≤13B parameters) — weights, papers, tools, and techniques for running AI on consumer…☆18Apr 20, 2026Updated 6 months ago
- Makefiles, and source-codes for my openwrt-useful-tools repo.☆17Apr 29, 2022Updated 4 years ago
- Zero-config local LLM optimization for Ollama, LM Studio, and Apple Silicon MLX. Reduces TTFT by 40%, wall time for local agents by 46%, …☆34Oct 1, 2026Updated 3 weeks ago