☆17Jun 17, 2026Updated 4 months ago
Alternatives and similar repositories for quant-toolkit
Users that are interested in quant-toolkit are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A high-throughput and memory-efficient inference and serving engine for LLMs☆47Oct 27, 2026Updated 2 weeks ago
- Docker images for LLM inference (SGLang + vLLM) on NVIDIA Blackwell GPUs (SM120, CUDA 13.2)☆100Oct 20, 2026Updated 3 weeks ago
- VellumForge2 is a Golang CLI for generating high-quality Direct Preference Optimization datasets via a hierarchical prompt pipeline with …☆22Feb 15, 2026Updated 8 months ago
- Research MIL-to-HWX compiler for the M4 Apple Neural Engine☆18Sep 3, 2026Updated 2 months ago
- MiniMax-M3 (MXFP4, MSA) serving on SM120 (RTX PRO 6000 Blackwell) — patched vLLM image + launch recipe, 192K context☆22Jun 15, 2026Updated 4 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Archived: b12x development has moved to FlashInfer. See README for migration and PR-porting guidance.☆270Oct 6, 2026Updated last month
- Tencent Hunyuan 3 (295B MoE) on 2x NVIDIA DGX Spark: NVFP4 W4A16 + native MTP speculative decoding. First published MTP-on-GB10 numbers, …☆19Jul 13, 2026Updated 4 months ago
- LLM inference decode throughput benchmark with Rich TUI dashboard. Measures token generation speed across concurrency levels and context …☆129Nov 4, 2026Updated last week
- Apple Neural Engine on Linux: verified gemm/softmax/attention/transformer-block primitives, driven from Python on an M1 under Omarchy Mac☆20Updated this week
- Benchmarking tool for vLLM inference performance with GPU monitoring☆54Updated this week
- ☆23Feb 17, 2026Updated 8 months ago
- This is the repo with the code to conduct a comparative analysis of different audio representation models.☆11Aug 31, 2023Updated 3 years ago
- 7.67× LoRA / 8.35× Full FT speedup for Qwen3.5 (0.8B–27B) on NVIDIA DGX Spark — wall-clock parity with rented H100. Lossless within BF16.…☆13May 19, 2026Updated 5 months ago
- ☆800Updated this week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Zero-dependency Dynamax workflows for pi: live parallel subagents, typed handoffs, synthesized results.☆12Oct 29, 2026Updated 2 weeks ago
- Convert StableHLO models into Apple Core ML format☆22Sep 12, 2026Updated 2 months ago
- Deep dive into Apple's AFMTextV7: 3.18B parameter foundation model with hybrid transformer architecture, native LoRA integration, and 1GB…☆32Jun 14, 2025Updated last year
- Native DeepSeek V4.1 Flash inference across one RTX PRO 6000 and four DGX Spark expert workers☆42Sep 25, 2026Updated last month
- ☆13Apr 8, 2021Updated 5 years ago
- A script for MIDI/AUDIO routing in Max for Live devices.☆12Dec 27, 2024Updated last year
- An ultra-fast, distributed Safetensors loader☆93Updated this week
- Controlling Ableton Live with TypeScript.☆15Apr 10, 2018Updated 8 years ago
- DeepSeek Harness URL reader: fetch any page and return clean main-content text/Markdown. Auto charset (GBK/GB2312/UTF-8/Big5), token-effi…☆24Oct 19, 2026Updated 3 weeks ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- antirez/ds4-style hybrid quant DeepSeek V4 Flash on a single DGX Spark via vLLM☆18May 11, 2026Updated 6 months ago
- Eight-system DGX Spark engineering: fabric repair, NCCL tuning, rack recabling, custom 3D-printed PSU supports, and thermal validation.☆11Aug 3, 2026Updated 3 months ago
- OpenSCAD script to create custom 3D printable cable ducts.☆11Jun 15, 2025Updated last year
- ☆37Apr 26, 2026Updated 6 months ago
- High-performance single-GPU inference for selected model checkpoints and GPUs.☆12Oct 28, 2026Updated 2 weeks ago
- ☆11Jun 21, 2023Updated 3 years ago
- MiniMax H3-Base video+audio on two NVIDIA DGX Sparks: vLLM-Omni text-encoder TP2 + Ulysses SP2 across a ConnectX-7 cable, 10 s 1344x768 c…☆15Updated this week
- GA100 voltage glitch resources☆49Updated this week
- Raw benchmark logs for Swift-Qwen3.8-27B vs the Qwen3.8-27B BF16 base: every response, score, and config across 9 benchmarks☆13Sep 13, 2026Updated last month
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Reproducible kit to deploy DeepSeek-V4-Flash-DSpark on a 2× NVIDIA DGX Spark (GB10) cluster: vLLM TP=2 over QSFP 200GbE, NVFP4 KV, DSpark…☆13Aug 24, 2026Updated 2 months ago
- CLI tool using ripgrep and treesitter to produce code skeletons for agentic programming☆14Oct 3, 2026Updated last month
- Experimental runtime reclamation of GB10 display-reserved memory into ordinary Linux RAM, with guarded driver, local signing, and reboot …☆13Oct 23, 2026Updated 2 weeks ago
- GLM-5.3-Flash (EXL3) on 2x NVIDIA DGX Spark - Extended KV cache☆13Sep 8, 2026Updated 2 months ago
- ☆11Nov 29, 2017Updated 8 years ago
- A ledger-backed decision network that records AI decisions and connects them to the facts and earlier answers they use.☆18Nov 2, 2026Updated last week
- ✨✨VITA: Towards Open-Source Interactive Omni Multimodal LLM☆11Jun 16, 2025Updated last year
Are these results useful?