High-performance LLM inference engine — drop-in replacement for Ollama with faster multi-turn inference, lower TTFT, and higher throughput through prefix caching and continuous batching.
☆185Aug 9, 2026Updated this week
Alternatives and similar repositories for fox
Users that are interested in fox are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Generate Agent Skills from MCP server tools. Connects via Streamable HTTP, discovers tools, and outputs a skill with schema docs and a ca…☆16Feb 15, 2026Updated 5 months ago
- A minimal, async-first AI agent framework in Rust with multi-provider support (OpenRouter, OpenAI, Anthropic, Ollama), JSON schema-based …☆15Apr 27, 2026Updated 3 months ago
- vLLM fork with Marlin W4A8 SM121 patches + TMA module☆16Mar 23, 2026Updated 4 months ago
- Open-source LLM observability and evaluation platform☆15Jul 13, 2026Updated 3 weeks ago
- SmarterRouter: An intelligent LLM gateway and VRAM-aware router for Ollama, llama.cpp, and OpenAI. Features semantic caching, model profi…☆146May 10, 2026Updated 3 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Krasis is a Hybrid LLM runtime which focuses on efficient running of larger models on consumer grade VRAM limited hardware☆509Updated this week
- a set of scripts to easily convert all training data from huggingface into alpaca instruct or sharegpt format, which should allow for eas…☆20Mar 14, 2025Updated last year
- Your AI colleague, in the apps you already use.☆14Updated this week
- llama.cpp fork with AMD XDNA2 NPU backend for Ryzen AI MAX (npu5/XDNA2) — matrix multiply offload via XRT☆19Apr 1, 2026Updated 4 months ago
- The go to place for official fluvio connectors☆22Apr 26, 2023Updated 3 years ago
- AI accelerators, edge inference devices, compilers, runtimes, benchmarks, and research for building and evaluating machine-learning syste…☆18Jun 16, 2026Updated last month
- A Simple way to draw text in macroquad with support of using glyphs from multiple fonts in a single draw_text call, also known as fallbac…☆11Feb 4, 2024Updated 2 years ago
- The Rust library for video generation models based on Candle (HF)☆23Jul 24, 2026Updated 2 weeks ago
- Python tools for analyzing Claude Code conversation history☆23May 21, 2026Updated 2 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- ☆26Oct 3, 2025Updated 10 months ago
- 🦀 Claude Code toolkit for self improving skills, performance and mcp-essentials☆35Apr 29, 2026Updated 3 months ago
- ☆24Feb 7, 2026Updated 6 months ago
- SwiftLet is a lightweight Python framework for running open-source Large Language Models (LLMs) locally using safetensors☆29Aug 6, 2025Updated last year
- Build real software step-by-step with Claude, Codex, OpenCode, Gemini, Cursor, and other agents☆15Mar 29, 2026Updated 4 months ago
- Pure Rust Inference Engine☆638Updated this week
- Mooch - Your Interview Pal☆17Updated this week
- AI Intelligence Platform -- knowledge graph + semantic search + reasoning + multi-agent debate in a single binary☆18Apr 10, 2026Updated 4 months ago
- llama.cpp/ik_llama.cpp launcher: loads big MoE models across mismatched multi-GPU rigs by exact VRAM math.☆263Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Thermal pocket printer - BLE protocol reverse engineering, Python CLI, and web GUI☆15May 4, 2026Updated 3 months ago
- The weight-bearer: the anchor point that unifies the good ideas in ethics, and the manifesto/prompt as the counterweight that aims to tak…☆17Jul 22, 2026Updated 2 weeks ago
- A minimal implementation of ZKPs of Ethereum block execution using Reth. Supports both Ethereum and OP Stack.☆13Jul 2, 2025Updated last year
- A Blog & RSS system written in Rust based on Luke Smith's LB.☆24Jun 16, 2022Updated 4 years ago
- Docker container image for the bluetooth presence monitor found at https://github.com/andrewjfreyer/monitor☆15Jan 21, 2020Updated 6 years ago
- Frona is a personal AI assistant. You create autonomous agents, give them tools, and talk to them through a chat interface. Agents act on…☆198Jul 10, 2026Updated last month
- Tap into any binary's traffic, including decrypted TLS - no root required.☆28Jun 21, 2026Updated last month
- Mixed-vendor GPU inference cluster manager with speculative decoding☆31Jul 2, 2026Updated last month
- Rust-libp2p transport for {t,n}-threshold signature schemes☆33Jul 8, 2022Updated 4 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Grammar checker with a keyboard shortcut for Ollama and Apple MLX with Automator on macOS.☆82Feb 5, 2024Updated 2 years ago
- Simple Custom Element using Custom Elements v1, TypeScript 2.x, lit-html and WebPack 3☆11Feb 23, 2018Updated 8 years ago
- autoresearch for everything — autonomous iterative improvement for any system☆38Apr 2, 2026Updated 4 months ago
- Golang implementation of the BIP32/BIP39/BIP43/BIP44/SLIP44/BIP49/BIP84/BIP173 for creating and recoverying keys, mnemonic seeds and Hier…☆12Feb 7, 2021Updated 5 years ago
- An enchanced useState hook which keeps track of the states history, allowing you to undo and redo states.☆16Apr 20, 2022Updated 4 years ago
- AI agent skill for Instagram comment-to-DM funnels. Automate lead capture from post comments via Upload-Post API.☆19Mar 28, 2026Updated 4 months ago
- Interactive code walkthrough skill with VS Code highlighting and AI-powered voice narration☆88Mar 9, 2026Updated 5 months ago