Agent skill for hill-climbing local LLM serving speed (decode, speculative decoding, prefill, KV, startup, TTFT) on any hardware and quantization
☆258Nov 16, 2026Updated this week
Alternatives and similar repositories for inference-optimisation-skill
Users that are interested in inference-optimisation-skill are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A skill and CLI that lets small local models like LFM3-1.7B make 3D printable parts, from words or a picture, even through context compac…☆32Updated this week
- An 89 KB ternary System-1 decision model in SSD SRAM for zero-byte-loss ransomware rollback.☆58Updated this week
- Claude Code ZeroClaw Pro 2026: AI Multitool & CLI Router for Claude SDK Subagents☆52Updated this week
- Hermes Captain: a Hermes Agent plugin that makes your Hermes the captain of all your coding agents, on any machine.☆30Updated this week
- Recipe (profiles + docs) to serve Qwen3.8-Flash-Next on 1 or 2 DGX Sparks with the Zig TensorFold engine + Compute Lanes. Engine: github.…☆17Updated this week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Steer your ideas in realtime☆233Updated this week
- A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative…☆11Nov 10, 2026Updated last week
- (Continuously) scans your internet facing infrastructure to discover exposed ports and services, helping you identify changes and reduce …☆12Updated this week
- ☆138Updated this week
- Imagination Studio by keys+Wasserman powered by TensorFold: an AI film studio for Mac and NVIDIA DGX Spark. Plan a film like a crew (Slat…☆1,133Updated this week
- 101 unique CLI/TUI skin themes for Hermes Agent — cyberpunk, dark OLED, nature, retro, pastel, light mode, fantasy, and more.☆84Oct 29, 2026Updated 2 weeks ago
- TypeScript SDK for the NitroPing audit log — batching client, error capture, Hono/Express/Nitro adapters, and GenAI cost tracing.☆24Aug 26, 2026Updated 2 months ago
- Your proactive AI assistant: reads your email, chats, calendar and phone, turns what matters into to-dos, prepares the work, and only sen…☆16Updated this week
- glm53-flash recipe for tp=2 GB10☆18Oct 29, 2026Updated 2 weeks ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Hardware build recipes☆24Updated this week
- An in-app browser pane for DeepSeek Harness — real Chrome over CDP, plus rendered previews of local files, markdown and PDFs.☆15Sep 28, 2026Updated last month
- An opinionated, personal ADE that supports remote backends, agent tools exposed over a control plane and scriptable notification hooks in…☆17Updated this week
- Open-source, self-hosted Grok Bot alternative☆232Updated this week
- Dot-lattice art: photo to two-tone dot map to seamless animated loop (engine + scripts)☆274Oct 25, 2026Updated 3 weeks ago
- ☆41Aug 16, 2026Updated 3 months ago
- Claude Code skill for writing viral X/Twitter posts using 23 proven plug-and-play formulas. Based on research by Leon (@Unfungible).☆14Feb 18, 2026Updated 8 months ago
- Scarlet is an AI video editor for macOS and Windows.☆346Updated this week
- MiniMax H3 (video + audio) on TensorFold 0.6.5 with an H3 family, Mac Studio M5 Ultra: 5 s 864x480 clip in ~50 s, 40 s at 768x448 — the f…☆31Oct 7, 2026Updated last month
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Reverse engineering with AI agents on Windows: verifying, measuring and visualising the tools agents use, with rea and Ghidra☆19Oct 26, 2026Updated 3 weeks ago
- ☆91Nov 4, 2026Updated last week
- An environment where open models work as agents: a first-level harness with routing, skills, memory and sandboxed tools, on an engine tha…☆80Updated this week
- Breaking the quadratic memory barrier in AI☆60Oct 13, 2026Updated last month
- Head-to-head comparison of local LLMs for agentic workflows (Hermes Agent, tool-eval-bench)☆36Oct 4, 2026Updated last month
- Train AI coding agents with RL (GRPO) on Prime Intellect — works with Pi Agent☆26May 13, 2026Updated 6 months ago
- A tiny system one model for code readability and hygiene.☆149Updated this week
- Source-backed developer tools for Alchemy Domain aggregates: inspect contracts, decisions, events, and evolution.☆26Updated this week
- Serve Ornith-1.5-35B-A3B (NVFP4 + in-checkpoint MTP, 256k ctx) on one DGX Spark — vLLM b12x recipe plus CUDA-graph fixes.☆33Aug 19, 2026Updated 2 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Local diagnostic CLI for NVIDIA DGX Spark (GB10). Detects power caps, UMA pressure, thermal risk, CUDA 13/SM_121 wheel mismatches, Docker…☆166Updated this week
- GLM-5.2 UD-Q2 decode speedup: CPU∥GPU MoE expert-split (harness, specs, de-risk)☆23Aug 9, 2026Updated 3 months ago
- Weight-Space Programming Without LLMs☆49Updated this week
- Photo deblurring for ComfyUI with HI-Diff and MISCFilter. comfy ui节点以及工作流支持手抖与运动模糊修复、原尺寸分块处理及模型下载。☆93Nov 7, 2026Updated last week
- llama-server start/stop scripts for Qwen3.6-35B-A3B UD-Q8_K_XL GGUF on DGX Spark☆26Jul 6, 2026Updated 4 months ago
- 31 free marketing skills for your AI agent: research, positioning, copy, pages, SEO, AI search, ads, email and content, plus a deep local…☆197Updated this week
- REAP expert pruning for MoE LLMs on Apple Silicon via MLX☆58Mar 16, 2026Updated 8 months ago
Are these results useful?