TurboQuant KV cache compression plugin for vLLM — asymmetric K/V, 8 models validated, consumer GPUs
☆51Apr 10, 2026Updated 7 months ago
Alternatives and similar repositories for turboquant-vllm
Users that are interested in turboquant-vllm are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- vLLM TurboQuant☆619Jun 25, 2026Updated 4 months ago
- Production RAG hallucination detection + self-healing pipeline — 5 checks, 3 healing strategies, zero external APIs☆14May 7, 2026Updated 6 months ago
- Run DeepSeek-V4-Flash-0731, GLM-5.3-Flash on a single NVIDIA GB10 / DGX Spark - 2-bit MoE planes, FP4 quality recovery, speculative decod…☆16Oct 24, 2026Updated 3 weeks ago
- AI Business Operating System — run your business with AI agents. Local-first, multi-provider, governed.☆11Sep 4, 2026Updated 2 months ago
- Browse and play existing Eufy HomeBase recordings in Home Assistant. Events timeline, snapshots and on-demand WebRTC video/audio. HACS in…☆15Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Drag and drop 3d print repair utility for OSX.☆15Jun 12, 2026Updated 5 months ago
- Developing a legal research tool leveraging ChatGPT / GPT-4☆14Mar 10, 2024Updated 2 years ago
- Production-speed compact Dynamic Memory Sparsification (DMS) for KV cache compression☆27Oct 27, 2026Updated 3 weeks ago
- fused MoE kernel in Candle backend☆14Feb 3, 2026Updated 9 months ago
- The name speaks for itself.☆13Jun 2, 2025Updated last year
- PyTorch code for full quantization of DNN using BCGD☆14Jul 24, 2019Updated 7 years ago
- A MCP (Model Context Protocol) server to allow code security reviews using https://osv.dev (Open Source Vulnerabilities Database)☆15Dec 24, 2025Updated 10 months ago
- Self-hosted Spotify-style music server for your own library: web, Android, native iPhone, Mac, Windows and TV apps, handoff between devic…☆26Updated this week
- ☆18Mar 31, 2026Updated 7 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Experiments codes for COLING '22 paper "Augmenting Legal Judgment Prediction with Contrastive Case Relations"☆11Apr 25, 2024Updated 2 years ago
- SearXNG web search plugin for OpenClaw - privacy-preserving search via self-hosted SearXNG☆12Feb 26, 2026Updated 8 months ago
- Sovereign programming language for the Apple Neural Engine: .cy source -> HWX Mach-O binaries + organism VM, on-chip grad/Adam, compile-t…☆17Updated this week
- ☆12May 14, 2026Updated 6 months ago
- Репозиторий курса "Modern Storages and Data Warehousing", ПИ, НИУ ВШЭ, 2024☆16Apr 13, 2025Updated last year
- Apple Health to your own database. Export files, build dashboards, and connect AI with read-only MCP. Open-source iOS app, sync protocol,…☆26Updated this week
- YouTube agent via a custom MCP server☆17Oct 5, 2025Updated last year
- ☆12Apr 17, 2025Updated last year
- Weather-aware window ventilation and indoor-comfort recommendations for Home Assistant.☆33Updated this week
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Experimental runtime reclamation of GB10 display-reserved memory into ordinary Linux RAM, with guarded driver, local signing, and reboot …☆13Oct 23, 2026Updated 3 weeks ago
- ☆27Nov 5, 2026Updated last week
- An integration of Qdrant ANN vector database backend with txtai☆25Jun 23, 2026Updated 4 months ago
- Collection of shortcuts to keep track of your meetings.☆26Mar 31, 2026Updated 7 months ago
- Pure Rust OCR pipeline that re-implements the PaddleOCR (DBNet + SVTR\_HGNet) models without relying on C/C++ runtimes.☆21Oct 22, 2026Updated 3 weeks ago
- An interactive course on prompt engineering for lawyers built using streamlit.☆19Sep 1, 2024Updated 2 years ago
- Python tool for exploiting CVE-2021-35616☆11Dec 3, 2021Updated 4 years ago
- 本科毕设:基于金融知识图谱的推荐系统☆13May 11, 2024Updated 2 years ago
- A LaTeX template for HSE University☆14Aug 10, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- The fastest inference engine for Qwen3.8-27B on the NVIDIA RTX 5090: up to 500 tokens/s for one agent and up to 2,000 tokens/s for many, …☆85Nov 4, 2026Updated 2 weeks ago
- My investigation of Voxtral Mini-3B's capabilities.☆15Jul 17, 2025Updated last year
- Claude Code skill: let your agent drive fleets of local omp (oh-my-pi) model instances toward one goal — provider config, bounded turns, …☆15Aug 28, 2026Updated 2 months ago
- Qwen3.8-Flash-Next (176B MoE) on a single RTX PRO 6000 Blackwell 96GB — NVMe-streamed PLE table, CUDA graphs with NEXTN speculation, meas…☆10Aug 28, 2026Updated 2 months ago
- Efficient GPU kernels for mixed-precision Vision Transformers in Triton☆18Sep 18, 2025Updated last year
- Go implementation of Recursive Language Models (RLM) - inference-time scaling for arbitrarily long contexts☆21May 12, 2026Updated 6 months ago
- Extension components for ChatGPT Apps SDK - Maps, Albums, Carousels and more. Built on @openai/apps-sdk-ui.☆15Dec 30, 2025Updated 10 months ago
Are these results useful?