LLM inference in C/C++
☆435Oct 17, 2026Updated this week
Alternatives and similar repositories for llama.cpp-adaptive-kv-streaming
Users that are interested in llama.cpp-adaptive-kv-streaming are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A lightweight CPU only memory approach with ranked retrieval. Simple, yet effective.☆136Sep 19, 2026Updated 3 weeks ago
- MiniMax-H3超级缓存加速插件☆334Aug 3, 2026Updated 2 months ago
- Frontier-class LLM inference on a laptop CPU — gpt-oss:20b at ~110 tok/s on Apple M4 Max, 7.5x llama.cpp, no GPU. From-scratch NEON/SME k…☆56Aug 11, 2026Updated 2 months ago
- Unified surface to list, toggle, group, and focus tools from any Pi extension (including MCP), with active context-cost tracking. State p…☆37Oct 8, 2026Updated last week
- Browser-based 3D previs workspace for storyboarding, camera blocking, character posing and keyframes☆107Aug 29, 2026Updated last month
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Local, gradient-free neuro-symbolic memory engine combining Hyperdimensional Computing (HDC/VSA), Hebbian plasticity, and graph triples f…☆143Oct 11, 2026Updated last week
- LLM inference in C/C++☆142Updated this week
- KVMem virtualizes KV memory across inference backends to make ultra-long-context local AI accessible on limited hardware.☆1,069Updated this week
- ☆72Updated this week
- Small, fast, free: an open recipe for a sub-100M TTS. Code, data, weights. The PoC trained to a working model in a few hours on one RTX 3…☆40Sep 30, 2026Updated 2 weeks ago
- C++/ggml port of TRELLIS.2 stage-1 geometry (image -> watertight mesh)☆96Jun 4, 2026Updated 4 months ago
- Gemma 4 E2B inference in pure C☆173Sep 28, 2026Updated 2 weeks ago
- MiniMax H3全能参考插件，B站/Youtube：在下鱼酥☆92Oct 9, 2026Updated last week
- High-performance single-GPU inference for selected model checkpoints and GPUs.☆3,056Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Local JavaScript + FastAPI video restoration studio for SeedVR2 with TensorRT acceleration, previews, synchronized comparisons, resumable…☆167Sep 5, 2026Updated last month
- DeepSeek-V4-Flash-0731 on 4x CMP 170HX (sm_80): 98 tok/s decode, ~5300 tok/s prefill. DSpark speculative decoding under pipeline parallel…☆118Aug 13, 2026Updated 2 months ago
- Firefox MCP☆22Updated this week
- 🐼 Steer your LLMs and agents at the token level: A web tool for token visualization & control, model inspection, and LLM & agent traject…☆61Updated this week
- Browse, filter, export, and resume local Codex, Claude Code, Gemini CLI, Pi, and Antigravity sessions.☆33Sep 12, 2026Updated last month
- A powerful, ComfyUI Custom node automation suite for generating cinema-production-grade prompts explicitly formatted for the **MiniMax H3…☆247Sep 12, 2026Updated last month
- Reverse engineering the Samsung Odyssey G5 (LS32CG552) firmware: signature check bypass, modified firmware flashed over USB, and hidden f…☆32Updated this week
- Pi, the coding agent, compiled ahead of time to native code. Starts 3× sooner than Pi on Bun and uses about a third of its CPU.☆365Updated this week
- A prompt builder and media manager for MiniMax H3.☆291Updated this week
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Augmented Vertex Block Descent (SIGGRAPH 2025) in TypeScript, Three.js and WebGPU☆140Updated this week
- Unified algorithmic compaction + observational memory for Pi. Merges pi-vcc and pi-observational-memory with fallback chains, cooldowns, …☆247Updated this week
- Tuning and qualification harness for the NVIDIA CMP 170HX (GA100). Measures, gates and recovers clock/voltage settings, and treats a comp…☆89Sep 28, 2026Updated 2 weeks ago
- Serve EXL3 (ExLlamaV3 trellis) quantized models on vLLM fork runtimes — any architecture, mixed per-layer bitrates, composable with sourc…☆26Updated this week
- One llama.cpp flag unlocks +33-39% decode speed for Qwen3.8-27B on consumer GPUs. The MTP head already ships inside your GGUF. Recipe, pa…☆363Sep 26, 2026Updated 3 weeks ago
- ☆80Updated this week
- What Claude Code is doing between your prompt and its answer, drawn live from the logs it already writes: every model call, every tool, e…☆47Updated this week
- Beginner-friendly Codex Skill for production-ready MiniMax H3 prompts.☆88Aug 24, 2026Updated last month
- Local LLM Search Index for RAG☆20May 5, 2026Updated 5 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆41Aug 16, 2026Updated 2 months ago
- SamuraiThirdPersonTemplateThreeJS☆105Aug 17, 2026Updated 2 months ago
- ☆491Sep 7, 2026Updated last month
- ☆159Jul 26, 2026Updated 2 months ago
- Container toolbox that runs llama.cpp with AMD ROCm and NVIDIA CUDA in one build, for inference on two GPUs☆20Updated this week
- Fast, lightweight and stealth Firecrawl alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Fir…☆76Updated this week
- Local MCP server for ComfyUI — run your local ComfyUI from AI agents☆284Updated this week