A local LLM server built for concurrent work. Drop-in replacement for Ollama and/or OpenAI and Ollama APIs on one port. Requests that share a prompt reuse each other's KV cache instead of each prefilling it. Rust, wrapping llama.cpp.
☆190Aug 22, 2026Updated 2 months ago
Alternatives and similar repositories for fox
Users that are interested in fox are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 3D Spiking neural network simulation exploring Spike Timing Dependent Plasticity (STDP)☆11Apr 1, 2026Updated 7 months ago
- Universal cognitive engine for AI. Features autonomy, self-reflection, and continuous learning via the Nine Questions loop.☆14Jun 13, 2026Updated 4 months ago
- Container toolbox that runs llama.cpp with AMD ROCm and NVIDIA CUDA in one build, for inference on two GPUs☆21Oct 16, 2026Updated 3 weeks ago
- DGX Spark EC fan speed override / rollback tool☆25Aug 23, 2026Updated 2 months ago
- Dockerized inference server and benchmarks for quantized Gemma 4 family on the NVIDIA DGX Spark (GB10). Features ARM64 CUDA 13 builds usi…☆13Jun 20, 2026Updated 4 months ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Krasis is a Hybrid LLM runtime which focuses on efficient running of larger models on consumer grade VRAM limited hardware☆526Updated this week
- Rust-host continuation of DwarfStar for explicit, hardware-validated large-model inference on DGX-Spark.☆19Updated this week
- Zero-Trust runtime authorization for OpenClaw agents. Block prompt injection and unauthorized tool calls before execution.☆24Mar 14, 2026Updated 7 months ago
- A minimal, async-first AI agent framework in Rust with multi-provider support (OpenRouter, OpenAI, Anthropic, Ollama), JSON schema-based …☆16Apr 27, 2026Updated 6 months ago
- Use AgentRouter models in OpenCode .☆31Jul 15, 2026Updated 3 months ago
- ~66% Faster, ~44% Less Tokens, The only AI coding workflow you need, Supports small models☆30Updated this week
- The main repository for the Discreet Node source.☆12Jul 9, 2024Updated 2 years ago
- Open-source LLM observability and evaluation platform☆16Jul 13, 2026Updated 3 months ago
- A powerful CLI tool to manage, test, and optimize RAG pipelines. Streamline your Retrieval-Augmented Generation workflows from terminal.☆23Jan 12, 2026Updated 9 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Protect your project from AI-driven reverse engineering tools like REA. Agent instruction barriers, terminal shims, and build hardening i…☆37Oct 26, 2026Updated last week
- OxiBonsai is a zero-FFI, zero-C/C++ inference engine for PrismML's sub-2-bit Bonsai family — both the 1-bit line (Q1_0_g128) and the tern…☆137Oct 8, 2026Updated last month
- Visual-first architecture workspace with typed graphs, deterministic validation, semantic diffs, and proposal-gated AI changes.☆16Aug 27, 2026Updated 2 months ago
- Logging library written in V☆11Apr 15, 2021Updated 5 years ago
- a set of scripts to easily convert all training data from huggingface into alpaca instruct or sharegpt format, which should allow for eas…☆20Mar 14, 2025Updated last year
- This repo is a alternative solution for standard self-attention. It uses tree routing with learnable functions for cheaper self-attention…☆43Oct 11, 2026Updated 3 weeks ago
- A repository to show all use case of Materia Design Components in Android☆10Oct 15, 2018Updated 8 years ago
- Collection of source code for Rosetta Code☆13Oct 8, 2021Updated 5 years ago
- The go to place for official fluvio connectors☆22Apr 26, 2023Updated 3 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- 学霸帝 Zero-to-CAD — AI驱动的CAD代码生成器，基于Qwen3-VL-2B微调模型☆12May 31, 2026Updated 5 months ago
- Qwen Code companion for Claude Code — delegate rescues, investigations, and code reviews to the qwen CLI from inside your Claude Code ses…☆11Apr 15, 2026Updated 6 months ago
- A floating ComfyUI chat assistant with workflow editing, vision, a docs knowledge base, and per-workflow sessions.☆34Updated this week
- Open Zed terminals inside tmux or zellij — port of vscode-mux to the Zed editor.☆18Sep 27, 2026Updated last month
- ⚡ Accelerate chat and IDE workflows with a proxy for llama.cpp, managing slots and cached context for efficient, low-latency interactions…☆10Oct 14, 2026Updated 3 weeks ago
- A minimal implementation of ZKPs of Ethereum block execution using Reth. Supports both Ethereum and OP Stack.☆13Jul 2, 2025Updated last year
- Zero-config local LLM optimization for Ollama, LM Studio, and Apple Silicon MLX. Reduces TTFT by 40%, wall time for local agents by 46%, …☆38Oct 25, 2026Updated 2 weeks ago
- Reproducible LLM inference on four NVIDIA DGX Spark (GB10) nodes wired as a direct switchless ConnectX ring — serving profiles, ring laun…☆21Oct 30, 2026Updated last week
- ☆153Sep 16, 2026Updated last month
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Simple static site generator written in Go☆13Apr 2, 2026Updated 7 months ago
- ☆23Mar 6, 2023Updated 3 years ago
- ☆13Sep 12, 2024Updated 2 years ago
- A demo of the Pushy SDK integrated into a sample Flutter app.☆12Nov 12, 2025Updated 11 months ago
- Experimental runtime reclamation of GB10 display-reserved memory into ordinary Linux RAM, with guarded driver, local signing, and reboot …☆13Oct 23, 2026Updated 2 weeks ago
- Curso completo para aprender Rust paso a paso☆18Sep 20, 2023Updated 3 years ago
- ☆10Oct 7, 2026Updated last month