TurboQuant KV cache compression for MLX with fused Metal kernels. 4.6x compression at 98% FP16 speed.
☆113Apr 30, 2026Updated 6 months ago
Alternatives and similar repositories for turboquant-mlx
Users that are interested in turboquant-mlx are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Cloudflare-native AI agent — 13 tools, codemode, 5-layer memory, self-learning, multimodal I/O. Telegram, Discord & WhatsApp bots. Web se…☆28Oct 8, 2026Updated 3 weeks ago
- A tiny server to run local inference on MLX model in the style of OpenAI☆13Jan 31, 2024Updated 2 years ago
- ⚡ Native MLX Swift LLM inference server for Apple Silicon. OpenAI-compatible API, SSD streaming for 100B+ MoE models, TurboQuant KV cache…☆792Updated this week
- Metal Flash Attention for MLX☆20Oct 1, 2026Updated 3 weeks ago
- Claude Code/Codex plugin: create virtual multi-repo workspaces that unify agents/commands/skills/hooks across sibling git repos.☆14May 27, 2026Updated 5 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- First MLX implementation of TurboQuant KV cache compression for Apple Silicon☆31Jun 2, 2026Updated 4 months ago
- Deploy Your Swarm In One Click with FastAPI, Uvicorn, and more ;)☆10Oct 13, 2025Updated last year
- ☆21Apr 30, 2026Updated 6 months ago
- OpenClaw AI Agent Swarm Dashboard☆36Apr 6, 2026Updated 6 months ago
- Digital wardrobe for your minecraft skins.☆10May 13, 2026Updated 5 months ago
- The honest macOS tune-up — diagnoses what's actually slow, fixes only what's safe & reversible, scores your Mac 0-100. One bash script, z…☆22Jun 13, 2026Updated 4 months ago
- Qwen3.8-27B on one DGX Spark GB10: DFlash 2 for 65 tok/s C1 and 120 C4; EAGLE 3/1/4 for ~191 C8, ~330 C16 and ~535 C32; native 262K, pinn…☆13Oct 6, 2026Updated 3 weeks ago
- ☆14Aug 11, 2025Updated last year
- ☆7,024Jul 20, 2026Updated 3 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Up to 4× faster LLM decoding on Apple Silicon, lossless. Native MLX port of DeepSeek's DSpark & z-lab's DFlash speculative decoding — Gem…☆730Oct 5, 2026Updated 3 weeks ago
- GLM-5.3-Flash EXL3 K2 2.33bpw on ONE DGX Spark: native MTP (layer 45, 288 experts), CUDA graphs on, full 262,144 ctx. Measured ~19 tok/s …☆11Sep 19, 2026Updated last month
- ☆14Jan 29, 2026Updated 9 months ago
- Qwen Code companion for Claude Code — delegate rescues, investigations, and code reviews to the qwen CLI from inside your Claude Code ses…☆11Apr 15, 2026Updated 6 months ago
- ☆54Sep 13, 2026Updated last month
- Anthropic MCP client for macOS☆15Jan 5, 2025Updated last year
- A native KOReader live-styled Markdown editor☆19Oct 17, 2026Updated last week
- An on device Agent Runtime☆23May 13, 2026Updated 5 months ago
- ☆31Sep 1, 2023Updated 3 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Micro Kernel wrinting in Swift Embedded for Arch ARM 64☆19Updated this week
- Visualize any codebase as an interactive force-directed graph. Analyze Python, JS/TS, and more -- see how files, classes, endpoints, and …☆15Feb 21, 2026Updated 8 months ago
- ☆68Jun 4, 2026Updated 4 months ago
- import your conversation history into AI 🫚☆17Sep 7, 2026Updated last month
- Render text in Three.js using Signed Distance Fields☆15Oct 15, 2026Updated 2 weeks ago
- A customizable Claude Code setup for knowledge workers: agents, safety hooks, skills, memory, and an Obsidian knowledge base. Clone, run …☆34Oct 23, 2026Updated last week
- Universal cognitive engine for AI. Features autonomy, self-reflection, and continuous learning via the Nine Questions loop.☆14Jun 13, 2026Updated 4 months ago
- An example implementation of RLHF (or, more accurately, RLAIF) built on MLX and HuggingFace.☆37Jun 21, 2024Updated 2 years ago
- ☆16Sep 25, 2026Updated last month
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- HydBCsForOF is a set of hydraulic engineering boundary conditions for OpenFOAM☆12Sep 23, 2026Updated last month
- Swipe keyboard for the KOReader☆20Oct 23, 2026Updated last week
- An agent that builds agents — closed-loop AI system that interviews, designs, tests, and ships standalone Python agents.☆14Jul 29, 2026Updated 3 months ago
- NewsAgent is an enterprise-grade news aggregation agent designed to fetch, query, and summarize news from multiple sources at scale.☆31Oct 13, 2025Updated last year
- Open Foam Docker Control/UI from Mac or PC☆15May 31, 2026Updated 4 months ago
- ☆10Jan 8, 2026Updated 9 months ago
- Cycle-accurate Apple //e and Apple II Plus emulator in the browser — WebAssembly core, WebGL CRT rendering, signal-accurate composite vid…☆20Updated this week