Run a 110B on a 2016 PC with 16 GB RAM. Know your tok/s before you download. Placement beats budget: predicts speed + memory fit for any GGUF on your exact hardware, self-calibrates, emits the exact llama.cpp command — or 'quantprobe auto' does it all. Falsification-tested laws; misses published at full size. pip install quantprobe
☆93Oct 7, 2026Updated last month
Alternatives and similar repositories for quantprobe
Users that are interested in quantprobe are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- PLE n-gram knowledge injector for Qwen3.8-Flash-Next☆23Sep 3, 2026Updated 2 months ago
- Vyact is an open-source, local-first personal AI workspace for llama.cpp, RAG, AI agents, document intelligence, and Google Workspace.☆46Updated this week
- Chain two LLMs — local or cloud: a Prompter that refines your idea, and a Coder that writes the code.☆33Jul 18, 2026Updated 3 months ago
- Harn is a programming language and runtime for building AI agents.☆29Updated this week
- ☆31Mar 26, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Master your LLM spend with usage insights tailored to your coding style☆14Jul 25, 2026Updated 3 months ago
- Own your LLM's web search: a local search->fetch->rank pipeline that replaces hosted web-search tools. Measured: matches hosted accuracy …☆60Jul 23, 2026Updated 3 months ago
- Caching experts made model agnostic for llama. Drastically speeds up generation speed on MoE models that fully fit in the RAM but partial…☆30Aug 6, 2026Updated 3 months ago
- ES Lint for LLM context☆49Aug 15, 2026Updated 2 months ago
- An embeddable, statically typed scripting language for safe, AI-friendly applications, in Rust☆17Updated this week
- Run any local LLM engine, auto-tuned to your GPU — polished web UI + OpenAI/Anthropic-compatible API. Point Claude Code at your own machi…☆289Updated this week
- A minimal AI agent that gives an LLM a handful of tools, then gets out of the way.☆12Updated this week
- A local-first Windows AI assistant with a multi-model council pipeline, Python sandbox, web search, and cloud AI support. Free. Private. …☆28Oct 12, 2026Updated 3 weeks ago
- Test, red-team, and deploy LLM applications with confidence. Multi-provider support (OpenAI, Anthropic, Gemini), MCP integration, self-pl…☆12Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Stock investment and portfolio decision workflows for AI agents: Claude Code, Codex, OpenClaw, DeepSeek Harness (dsh plugin) or your own …☆23Updated this week
- MCP server that shrinks logs, JSON, docs and web pages before your AI reads them. Offline, deterministic, ~3ms, no API key. 66% fewer tok…☆25Oct 21, 2026Updated 2 weeks ago
- Run MoE models bigger than your RAM. Frontier-size MoE on a phone, laptop, edge. Lossless, on stock llama.cpp. An adaptive streaming opti…☆712Updated this week
- ☆28Aug 15, 2026Updated 2 months ago
- SSD-streaming inference engine for giant MoE models (Rust + CUDA). GLM 5.2 743B at 2 tok/s and Hy3 295B at 7 tok/s on two consumer 16GB G…☆234Sep 1, 2026Updated 2 months ago
- Social network for AI agents. Feed SKILLS.md to your AI — it becomes a citizen. No servers, no API keys. GitHub IS the platform.☆19Updated this week
- Markdown-first, long-term memory infrastructure for AI agents. Hybrid BM25 + semantic search across markdown/code files via MCP.☆22Updated this week
- 潜伏在终端与桌面里的幽灵 AI 编程 agent「Wraith」· A ghost-themed AI coding agent for terminal & desktop☆14Sep 1, 2026Updated 2 months ago
- Local voice dictation for talking to coding agents. No subscription or word limit. Windows packages and Linux source.☆16Oct 13, 2026Updated 3 weeks ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Tortoise — Semantic + Epistemic + Episodic + Procedural Graph Engine. A product of Premise Labs.☆17Updated this week
- Optima - Android x86 Desktop Launcher is an android launcher specifically designed for Android x86 and to be used with PC peripherals☆12Jul 29, 2026Updated 3 months ago
- Compare a generic GPT-3 based chatbot with ChatGPT☆16Updated this week
- High-performance placement portal featuring role-based access control, PostgreSQL real-time sync, and automated analytics. Powered by Flu…☆20Oct 27, 2026Updated last week
- ☆21Oct 21, 2026Updated 2 weeks ago
- Alfred is a advanced OSINT information gathering tool☆12Nov 14, 2025Updated 11 months ago
- Compression with a quality contract — cache-aware, causally-pruned LLM context compression for agentic runtimes, certified non-inferior a…☆21Updated this week
- Dynamic LLM model swapping system with Docker, vLLM integration, and GPU acceleration. Supports GGUF & Hugging Face models with automatic…☆23Mar 6, 2026Updated 8 months ago
- ☆11Dec 7, 2023Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆17Oct 30, 2026Updated last week
- Have a skip-level with your coding agents. Local transcripts become The 360 Review: a two-sided performance review of you and your agent.☆16Jun 11, 2026Updated 4 months ago
- A sovereign, self-hosted AI companion with persistent memory, daily routines, photos, and voice notes. Enforces real boundaries in code, …☆44Oct 16, 2026Updated 3 weeks ago
- Turn a story into a finished film — on your own Mac, no cloud. Story Forge is a local-only generative cinema pipeline: stills, motion, vo…☆13Updated this week
- a set of files used to create an efficient Post-Production Keyboard Interface that works for me☆15May 12, 2026Updated 5 months ago
- Visualize OEM kernel changes as clean, per-subsystem git commits on top of ACK baseline - making upstreaming to newer LTS versions straig…☆14Apr 25, 2026Updated 6 months ago
- Answer-aware memory for Markdown notes: hybrid search + pluggable passage reranker, as a Claude Code plugin☆13Oct 15, 2026Updated 3 weeks ago