Fast KV-cache quantization for Apple Silicon (MLX) — 43 research-adapted compression methods with Metal kernels
☆35Nov 9, 2026Updated this week
Alternatives and similar repositories for VeloxQuant-MLX
Users that are interested in VeloxQuant-MLX are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The AI runtime optimized for Apple Silicon. Configure a fleet of machines. Define missions and launch complex task graphs. Monitor everyt…☆12Updated this week
- An embeddable, statically typed scripting language for safe, AI-friendly applications, in Rust☆16Updated this week
- Menu-bar system monitor for Apple Silicon (optional local AI agent). Rust + Tauri. No cloud telemetry.☆18Updated this week
- Test, red-team, and deploy LLM applications with confidence. Multi-provider support (OpenAI, Anthropic, Gemini), MCP integration, self-pl…☆12Updated this week
- Text embedding and re-ranking in Rust☆14Aug 5, 2026Updated 3 months ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Persistent AI memory for Claude Code, OpenClaw, and any MCP-compatible agent. BM25F + vector hybrid, governance-aware, local-first, zero-…☆22Updated this week
- Social network for AI agents. Feed SKILLS.md to your AI — it becomes a citizen. No servers, no API keys. GitHub IS the platform.☆18Updated this week
- Interactive, animated architecture maps for any Hugging Face model — no weights downloaded☆13Sep 10, 2026Updated last month
- An agentic exploitation-evaluation harness: grade whether a coding agent can turn a known bug into an exploit, and contain it while it tr…☆13Aug 9, 2026Updated 3 months ago
- GLiClass inferences in Rust☆18Aug 5, 2026Updated 3 months ago
- Long-term memory for AI coding agents, kept as Markdown you own. Hybrid BM25 + vector search over your notes and code via MCP — one local…☆22Updated this week
- File System Change Notification Service☆16Oct 28, 2026Updated last week
- Extract authentication token from Evernote and exb database☆13Apr 23, 2025Updated last year
- Compression with a quality contract — cache-aware, causally-pruned LLM context compression for agentic runtimes, certified non-inferior a…☆21Updated this week
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Scan a codebase for AI SDKs, MCP servers and agent tools; map risks to NIST AI RMF, ISO 42001, EU AI Act and the OWASP LLM and Agentic To…☆22Updated this week
- The local inference server for coding agents. Pure Rust, one binary, Apple Silicon + NVIDIA. Anthropic + OpenAI APIs; the KV cache surviv…☆22Nov 1, 2026Updated last week
- The AI Runtime for Kubernetes☆44Updated this week
- A collection of strategy games and bots which seek to play them well.☆11May 18, 2024Updated 2 years ago
- Claude Code delegates coding to isolated CLI agents it doesn't trust (Codex, OpenCode, Pi, Pythinker), freezes what they produce, verifie…☆32Updated this week
- Personal Accountant Sample using Google-LLM-stack, Gemini and ADK for BWAI GDG Cloud Surabaya 2025☆12May 30, 2025Updated last year
- 🛡️ Programmable Guardrails for LLM Applications in Java. A framework-agnostic toolkit for input/output validation, PII masking, and jail…☆17Apr 15, 2026Updated 6 months ago
- Pure-Rust GGUF inference engine with quantized CPU, Metal & CUDA kernels, MoE support, OpenAI-compatible server. Benchmarked head-to-head…☆67Updated this week
- A command-line tool to scaffold and manage enterprise-ready AI Agents powered by the A2A (Agent-to-Agent) protocol☆15Updated this week
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Swift Package for creating, recording, and streaming virtual displays on macOS. Derived from Stengo/DeskPad.☆15Apr 16, 2026Updated 6 months ago
- A cognition kernel that wraps a frozen LLM in a persistent identity + trust + governance loop — testing whether capability comes from str…☆28Updated this week
- Beautifully made mobile code and markdown reader. Made for students, code readers and professionals.☆17Nov 3, 2026Updated last week
- fork of Microsoft Fastcontext repository☆15Jun 30, 2026Updated 4 months ago
- Docker container wrapping mixu's npm_lazy caching proxy for faster npm installs☆12Oct 28, 2026Updated last week
- Local-first control plane for AI-agent development — watch every Claude Code session live, ledger tasks/worktrees/resources, track token …☆14Oct 26, 2026Updated 2 weeks ago
- Text annotation and entity extraction☆15Nov 3, 2026Updated last week
- Zero and Few-shot document level relation extraction / ⚠️ Development moved to: https://github.com/cea-list-lasti/glidre☆19Mar 13, 2026Updated 7 months ago
- A cli tool to benchmark and stream events to a DuckLake or DuckDB destination.☆14Nov 2, 2026Updated last week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- 划词即理解的 AI 阅读工具 — Select text anywhere on macOS or windows system and get instant AI translate / explain / summarize in a floating bar. Ta…☆19Updated this week
- Self-hosted AI company OS for solo founders: autonomous agents, ERPNext business memory, and owner-visible governance.☆19Oct 23, 2026Updated 2 weeks ago
- ⚡ Nitro Ecosystem: The zero-overhead, type-safe FFI bridge for Flutter. Achieve sub-microsecond native performance (~1.5µs) with zero boi…☆12Updated this week
- An open-source algorithmic trading platform written in Python☆27Oct 5, 2026Updated last month
- Minimal surface, complete architecture: a small, local-first coding-agent harness that re-derives the invariants of DeepSeek Harness with…☆16Updated this week
- Rust library for BirdNET and Perch ONNX model inference with CUDA GPU support☆11Oct 22, 2026Updated 2 weeks ago
- Write, test, and explore SKSL shaders in real-time. A powerful web-based playground for creative coding with Skia's shader language.☆12Aug 19, 2026Updated 2 months ago
Are these results useful?