LLM inference in C/C++
☆56Aug 8, 2026Updated 2 months ago
Alternatives and similar repositories for llama.cpp
Users that are interested in llama.cpp are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- GLM-5.3-Flash EXL3 on one 24 GB RTX 3090 + DDR4: elastic GPU expert cache, zero-copy experts, AVX2 CPU tier, OpenAI API☆313Updated this week
- Single-request LLM serving recipes, patches, and benchmarks for modified RTX 2080 Ti 22GB / SM75 systems☆92Jun 10, 2026Updated 4 months ago
- A lightweight, keyboard-first Telegram client for the terminal☆50Oct 10, 2026Updated last week
- A painted music video for "Functional Emotions", made by Claude Opus 5.5: custom GPU brushstroke renderer, storyboard, and 7 parallel cha…☆71Sep 23, 2026Updated 3 weeks ago
- Qwen3.8-Flash-Next on 2× RTX 3090: with 128 GB RAM up to 4,191 tok/s prefill · 111.5 tok/s decode (131K prompt), full 256K window at 2,86…☆118Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Project Maya - run GLM-5.3-Flash (321B MoE) privately on your own GPU(s), from one card to 16, NVIDIA or AMD, Linux or Windows. Engine, s…☆999Updated this week
- Reproduce Lium's LocalMaxxing leaderboard runs (7 boards, 20 Verified) on a rented Lium GPU in one script — vLLM/llama.cpp recipes, measu…☆36Sep 26, 2026Updated 3 weeks ago
- Heterogeneous prefill/decode for DeepSeek-V4-Flash: CUDA prefill (DGX Spark, vLLM) -> Metal decode (Mac Studio, oMLX) over plain 10GbE☆151Updated this week
- [ECCV 2026] Low-Latency Event-Based Object Detection with Spatially-Sparse Linear Attention☆63Aug 26, 2026Updated last month
- Interactive canvas for taking an LLM apart tensor by tensor: measured INT8/INT4/FP8 error, distributions, spectra and outlier channels fo…☆75Sep 2, 2026Updated last month
- Praxen — agent behavior verifier. Compares an AI agent's declared policy against the available evidence; reports where observed behavior …☆61Updated this week
- Refusal removal as a loadable KV-cache graft — zero weight modification, no refusal-direction projection, fully reversible.☆181Sep 21, 2026Updated 3 weeks ago
- A plugin for Claude and Codex that intelligently manages outstanding questions, tasks, issues, and opportunities into one nicely organize…☆84Updated this week
- Single-file installer for a club-3090 webserver providing an admin control panel, a reverse proxy that automatically routes requests to t…☆28Jul 8, 2026Updated 3 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Deployment kit: Qwen3.8-27B EXL3 3.5bpw target + DFlash2 EXL3 5.0bpw speculative draft — launcher, config, model cards☆232Sep 1, 2026Updated last month
- Benchmark AI model speeds with TTFT, tokens/sec, and performance metrics .☆22Jul 23, 2026Updated 2 months ago
- HackRF Toolkit☆15Sep 6, 2026Updated last month
- Run python3 straight from Tasker without plugins☆18Apr 8, 2022Updated 4 years ago
- Optimized inference for the DGX Spark and spark clusters☆120Updated this week
- disassembler, decompiler and debugger in one, with a built-in mcp server: point an ai at a binary and it can debug it, not just read it. …☆170Sep 26, 2026Updated 3 weeks ago
- ☆97Updated this week
- Autonomous UAV navigation in GNSS-denied indoor spaces with no prior map: stereo VIO (MSCKF) and lidar-inertial odometry with map-based r…☆152Updated this week
- ARM-basedblackdeathfuture.☆17Dec 15, 2015Updated 10 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- A list of incidents where overreliance on generative AI and LLMs resulted in harm to companies, individuals, or society☆16Jun 19, 2026Updated 3 months ago
- whose's chaos v0.3☆18Sep 11, 2023Updated 3 years ago
- The mental model layer for agent-written code☆20Jan 21, 2026Updated 8 months ago
- ☆17Updated this week
- One llama.cpp flag unlocks +33-39% decode speed for Qwen3.8-27B on consumer GPUs. The MTP head already ships inside your GGUF. Recipe, pa…☆363Sep 26, 2026Updated 3 weeks ago
- KEV-gated continual-learning XSS specialist with execution-authoritative browser verification☆156Sep 28, 2026Updated 2 weeks ago
- Experimental Drosophila-inspired camera-to-robot bridge. Working mock neural backend, optical flow, IMU feedback and UDP motor control. M…☆229Updated this week
- Convert one or more Wave files to Morphagene reels.☆18Mar 26, 2022Updated 4 years ago
- ARTEX 한국어판 ·AI 기반 침해사고 대응 기능 추가 (upstream: Autumn-27/ARTEX, AGPL-3.0)☆193Updated this week
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Comprehensive, data-driven security assessment checklists across 23 platforms web, API, mobile, cloud, Active Directory, Kubernetes, LLM,…☆85Sep 16, 2026Updated last month
- Optimized SGLang runtime for Qwen3.8-27B FP8 with DFlash2 and Qwen3.8 Flash-Next NVFP4 with FR-Spec on one NVIDIA RTX PRO 6000 Blackwell …☆165Updated this week
- An AI-native penetration testing workbench where you and AI agents work together to accelerate your pentest workflow.☆100Updated this week
- ☆268Sep 8, 2026Updated last month
- Bluetooth in your Proxmox Linux VMs, finally. Pair controllers inside ChimeraOS/Bazzite/any Linux guest, even with Intel chips that can't…☆49Aug 7, 2026Updated 2 months ago
- Design for Error Detection in Deep-Research Agents Trajectories.☆25Jun 4, 2026Updated 4 months ago
- SQL queries for CSV files. The analytical CSV query engine for AI agents cli: csvql.☆30Updated this week