A local LLM server built for concurrent work. Drop-in replacement for Ollama and/or OpenAI and Ollama APIs on one port. Requests that share a prompt reuse each other's KV cache instead of each prefilling it. Rust, wrapping llama.cpp.
☆188Aug 22, 2026Updated last week
Alternatives and similar repositories for fox
Users that are interested in fox are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Profile-guided GPU kernel optimizer for AMD/RDNA3. Auto-tunes llama.cpp MMVQ kernels per model shape. 2x decode speedup on 7900 XTX.☆66Jul 7, 2026Updated last month
- Generate Agent Skills from MCP server tools. Connects via Streamable HTTP, discovers tools, and outputs a skill with schema docs and a ca…☆16Feb 15, 2026Updated 6 months ago
- Third party commentaries for UniqueBible☆13Apr 8, 2021Updated 5 years ago
- A minimal, async-first AI agent framework in Rust with multi-provider support (OpenRouter, OpenAI, Anthropic, Ollama), JSON schema-based …☆15Apr 27, 2026Updated 4 months ago
- vLLM fork with Marlin W4A8 SM121 patches + TMA module☆15Mar 23, 2026Updated 5 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆24Dec 29, 2025Updated 8 months ago
- Zero-Trust runtime authorization for OpenClaw agents. Block prompt injection and unauthorized tool calls before execution.☆24Mar 14, 2026Updated 5 months ago
- A powerful CLI tool to manage, test, and optimize RAG pipelines. Streamline your Retrieval-Augmented Generation workflows from terminal.☆23Jan 12, 2026Updated 7 months ago
- Zero-config local LLM optimization for Ollama, LM Studio, and Apple Silicon MLX. Reduces TTFT by 40%, wall time for local agents by 46%, …☆33Jun 30, 2026Updated 2 months ago
- A neural and statistical engine for accurately adding diacritics (Tashkeel) to Arabic text. First-place winner on Kaggle 🥇☆18May 29, 2025Updated last year
- llama.cpp fork with AMD XDNA2 NPU backend for Ryzen AI MAX (npu5/XDNA2) — matrix multiply offload via XRT☆20Apr 1, 2026Updated 5 months ago
- AI accelerators, edge inference devices, compilers, runtimes, benchmarks, and research for building and evaluating machine-learning syste…☆18Jun 16, 2026Updated 2 months ago
- Full-stack OpenTelemetry observability for Apache Spark☆18Updated this week
- The Rust library for video generation models based on Candle (HF)☆23Jul 24, 2026Updated last month
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Python tools for analyzing Claude Code conversation history☆26May 21, 2026Updated 3 months ago
- ☆148Aug 7, 2026Updated 3 weeks ago
- ☆24Feb 7, 2026Updated 6 months ago
- 🦀 Claude Code toolkit for self improving skills, performance and mcp-essentials☆36Apr 29, 2026Updated 4 months ago
- A CPU simulator framework built around, and to support the other tools under, the constraints of the first principles of computing projec…☆16Jun 15, 2026Updated 2 months ago
- Statically-linked Go wrappers for FFTW 3☆11Nov 25, 2018Updated 7 years ago
- Mooch - Your Interview Pal☆17Updated this week
- Pure Rust Inference Engine☆673Updated this week
- AI Intelligence Platform -- knowledge graph + semantic search + reasoning + multi-agent debate in a single binary☆19Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- llama.cpp/ik_llama.cpp launcher: loads big MoE models across mismatched multi-GPU rigs by exact VRAM math.☆267Updated this week
- Thermal pocket printer - BLE protocol reverse engineering, Python CLI, and web GUI☆18May 4, 2026Updated 3 months ago
- The weight-bearer: the anchor point that unifies the good ideas in ethics, and the manifesto/prompt as the counterweight that aims to tak…☆17Updated this week
- A minimal implementation of ZKPs of Ethereum block execution using Reth. Supports both Ethereum and OP Stack.☆13Jul 2, 2025Updated last year
- ☆22May 12, 2023Updated 3 years ago
- 🦀 A pure rust implementation of the TFHE Fully Homomorphic Encryption Scheme☆42Jun 22, 2026Updated 2 months ago
- On-device documentation search for agents☆54Mar 27, 2026Updated 5 months ago
- Tools for generating to and from wit format☆12Sep 6, 2024Updated last year
- Frona is a personal AI assistant. You create autonomous agents, give them tools, and talk to them through a chat interface. Agents act on…☆199Updated this week
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- An AI coding skill that transforms project planning into visual, interactive HTML decision documents☆55Apr 9, 2026Updated 4 months ago
- Tap into any binary's traffic, including decrypted TLS - no root required.☆28Jun 21, 2026Updated 2 months ago
- axe - a precision agentic coder. large codebases. zero bloat. terminal-native. precise retrieval. powerful inference.☆36Apr 16, 2026Updated 4 months ago
- Rust-libp2p transport for {t,n}-threshold signature schemes☆33Jul 8, 2022Updated 4 years ago
- Grammar checker with a keyboard shortcut for Ollama and Apple MLX with Automator on macOS.☆82Feb 5, 2024Updated 2 years ago
- Golang implementation of the BIP32/BIP39/BIP43/BIP44/SLIP44/BIP49/BIP84/BIP173 for creating and recoverying keys, mnemonic seeds and Hier…☆12Feb 7, 2021Updated 5 years ago
- AI agent skill for Instagram comment-to-DM funnels. Automate lead capture from post comments via Upload-Post API.☆20Mar 28, 2026Updated 5 months ago