Production-speed compact Dynamic Memory Sparsification (DMS) for KV cache compression
☆27May 6, 2026Updated 5 months ago
Alternatives and similar repositories for FastDMS
Users that are interested in FastDMS are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Portable optimized ROCm and Qwen3.8-27B setup for AMD Strix Halo☆85Sep 16, 2026Updated last month
- A Prometheus metrics exporter for NVIDIA DGX Spark clusters.☆25Feb 16, 2026Updated 8 months ago
- An example repo full of Douglas Adams quotes☆16Mar 12, 2024Updated 2 years ago
- vLLM + Qwen3.6-27B (BF16) OpenAI-compatible inference server on AMD Strix Halo (Ryzen AI Max+ 395, gfx1151). Vision input, 256K context, …☆18Apr 26, 2026Updated 5 months ago
- nagi-llm is a modern evolution of the NAGI interpreter, enhanced with AI and LLM-driven scripting.☆14Dec 17, 2025Updated 10 months ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Container toolbox that runs llama.cpp with AMD ROCm and NVIDIA CUDA in one build, for inference on two GPUs☆20Oct 16, 2026Updated last week
- High-performance batched Top-K selection for CPU inference. Up to 80x faster than PyTorch, optimized for LLM sampling with AVX2 SIMD.☆18Mar 20, 2026Updated 7 months ago
- Atlas Inference is a dependency free lightweight inference engine meant to run LLMs on YOUR compute seamlessly. Supports GB10 and Strix H…☆36Updated this week
- AI skill for parsing PDF, images, Word & PPT into Markdown/JSON via SoMark API. Works with Claude Code, Cursor, Cline and 40+ agents.☆18Aug 24, 2026Updated last month
- Full-fabric VHDL Qwen3.5 9B/ Qwen3.8 27B LLM inference engine on XCVU33P/XCVU35P☆42Oct 7, 2026Updated 2 weeks ago
- this is an easy way to make ai podcast useing ai loccaly like ollama and the tts of piper☆17Feb 17, 2026Updated 8 months ago
- A pure-Python system that automatically discovers, verifies, and applies relevant historical requirements for coding agents — no embeddin…☆38Sep 14, 2026Updated last month
- Strata Manager makes Niko1221/Strata, the local LLM inference engine, easier to set up and use. Manage local models and services, monitor…☆31Updated this week
- Umbrella repo for the ToxMCP Suite (docs, links, quickstart).☆28Oct 1, 2026Updated 3 weeks ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- meoo cli 是秒悟（Meoo）官方推出的命令行工具，让 Claude Code、Codex、Cursor、Qoder等本地 agent 在帮你写完前端代码后，能直接接管「数据库、用户登录、文件存储、部署上线」的所有云端工作——你只需要在终端跑一条命令，剩下的交给 AI…☆27Oct 15, 2026Updated last week
- Browser-based operator console for managing and monitoring Lemonade on Linux inference servers.☆20Aug 27, 2026Updated last month
- GPU-accelerated voice assistant — local LLM, fine-tuned Whisper, Kokoro TTS, AMD ROCm☆25Apr 2, 2026Updated 6 months ago
- Agent Skills for small-molecule and protein therapeutics: cheminformatics, molecular ML, docking and dynamics, protein design platforms, …☆45Updated this week
- 目标检测/分类/姿态标注工具，一键训练 模型，YOLO/LocateAnything自动标注☆39Sep 24, 2026Updated 3 weeks ago
- MCP server for Tailscale, backed by the tailscale CLI and control-plane REST API☆14Oct 10, 2026Updated last week
- Automated parameter sweep pipeline for finding optimal sampling settings for any local LLM on quantized weights☆22Feb 21, 2026Updated 8 months ago
- Portable vLLM builds with AMD ROCm acceleration for Lemonade☆80Sep 9, 2026Updated last month
- Differential-KV (DKV) is a sparse KV-cache inference runtime designed for high-efficiency, memory-bounded long-context Large Language Mod…☆21Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Jupyter Hub Support in VS Code☆17Oct 7, 2026Updated 2 weeks ago
- ☆49Updated this week
- ☆25Jul 22, 2026Updated 3 months ago
- ☆90Updated this week
- ☆17Aug 8, 2026Updated 2 months ago
- Set or toggle multiple monitor's input sources via DDC/CI☆13Mar 1, 2019Updated 7 years ago
- ☆13Jun 30, 2019Updated 7 years ago
- ENGRAFT: write facts into an LLM's n-gram (Engram) memory table as a removable overlay: 100 facts in a 9 MB file, no weights touched, ver…☆57Sep 30, 2026Updated 3 weeks ago
- LLM quantization optimizer☆23Aug 20, 2026Updated 2 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- The repo contains source code of sampling-based LTL (linear temporal logic) path planning project.☆11Sep 19, 2023Updated 3 years ago
- OpenSCAD script to create custom 3D printable cable ducts.☆11Jun 15, 2025Updated last year
- ☆12Apr 3, 2025Updated last year
- Research MIL-to-HWX compiler for the M4 Apple Neural Engine☆16Sep 3, 2026Updated last month
- Natural language control for Python CLI tools using locally-trained SLMs (CPU inference)☆33Oct 8, 2026Updated 2 weeks ago
- MiniMax-H3 on single DGX Spark: keys Sol-Engine ports + Heretic TE + Spectrum/Sage speed + 0.5MP upscaler finish. Formal bench included.☆49Aug 23, 2026Updated last month
- Hollow Knight: Silksong Dual-Screen Android port (+Steam integration)☆93Sep 25, 2026Updated 3 weeks ago