Serve EXL3 (ExLlamaV3 trellis) quantized models on vLLM fork runtimes — any architecture, mixed per-layer bitrates, composable with source-format non-routed weights
☆26Oct 15, 2026Updated this week
Alternatives and similar repositories for vllm-exl3
Users that are interested in vllm-exl3 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- vLLM inference solutions for NVIDIA GB10 (DGX Spark, sm121) — KIMI-K3 B12X_MLA + DSpark, GLM-5.2☆67Sep 30, 2026Updated 2 weeks ago
- Serve Qwen3.8-Flash-Next (turboderp ExLlamaV3 pack) on one NVIDIA DGX Spark with exllamav3☆62Updated this week
- DeepSeek-V4-Flash-0731 on 4x CMP 170HX (sm_80): 98 tok/s decode, ~5300 tok/s prefill. DSpark speculative decoding under pipeline parallel…☆118Aug 13, 2026Updated 2 months ago
- Tuning and qualification harness for the NVIDIA CMP 170HX (GA100). Measures, gates and recovers clock/voltage settings, and treats a comp…☆89Sep 28, 2026Updated 2 weeks ago
- Community-tested recipes, diagnostics, and benchmarks for CMP 170HX AI workloads☆83Oct 10, 2026Updated last week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- GLM-5.3-Flash (NVFP4) at TP=4 across 4x ASUS GX10 / GB10 - vLLM + mentat instead of Ray, 524k context, DFlash2. Minimal working recipe.☆87Updated this week
- ☆41Aug 16, 2026Updated 2 months ago
- First MLX implementation of TurboQuant KV cache compression for Apple Silicon☆31Jun 2, 2026Updated 4 months ago
- Community registry of LLM serving-path traps that produce confidently wrong measurements: templates, tool parsers, reasoning fields, quan…☆135Updated this week
- Minimal read-only OS image for GB10 (DGX Spark / ASUS GX10) boxes☆90Oct 4, 2026Updated last week
- ☆26Dec 12, 2024Updated last year
- Optimized inference for the DGX Spark and spark clusters☆120Updated this week
- HExBot just without malicious shit (and updates)☆10May 6, 2020Updated 6 years ago
- A curated list of tools, guides, playbooks, and resources for the NVIDIA DGX Spark (GB10 Grace Blackwell personal AI supercomputer).☆86Oct 8, 2026Updated last week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Chrome/Firefox extension for pen-testing to retrieve encryption keys of Widevine protected content !DON'T DECRYPT CONTENT UNLESS YOU HAVE…☆13May 7, 2025Updated last year
- System for verifying the correctness of generated Copilot programs☆19May 8, 2025Updated last year
- ⚡ Hermes Agent 2026: Next-Gen Multi-AI Desktop Automation Platform☆87Updated this week
- Low-latency collective transport and distributed LLM serving stack for switchless GB10 clusters.☆94Updated this week
- 🐼 Steer your LLMs and agents at the token level: A web tool for token visualization & control, model inspection, and LLM & agent traject…☆61Updated this week
- AGI runtime for bounded recursive self-awareness. Attempting machine consciousness at the Gödel–Turing–Hofstadter Nexus.☆17Oct 5, 2026Updated last week
- GLM-5.3-Flash (NVFP4) at TP4 across 4x DGX Spark via a switchless RoCE ring + DFlash2 — reproducible recipe☆106Updated this week
- Heterogeneous prefill/decode for DeepSeek-V4-Flash: CUDA prefill (DGX Spark, vLLM) -> Metal decode (Mac Studio, oMLX) over plain 10GbE☆151Updated this week
- This package is the JavaScript implementation of Deepgram's WebVTT and SRT formatting. Given a transcription, this package can return a v…☆17Aug 30, 2024Updated 2 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Fun terminal roster for Claude / Codex / Cursor / Grok rate limits☆55Oct 5, 2026Updated last week
- 用 TypeSafe Jev 推荐已安装 Skill / Bounded installed-skill recommendations with TypeSafe Jev. Python CLI, Codex skill, bilingual docs and live …☆34Sep 19, 2026Updated 3 weeks ago
- Maps: curated list of agent observability tools, standards and platforms (OTel GenAI, tracing, evals, guardrails, MCP)☆52Updated this week
- ☆56Sep 18, 2026Updated 3 weeks ago
- 86,420,337 lines — a 10 GB log — open in 80 ms, and 0 bytes of it live in memory. A Mac-native viewer and editor for the files that break…☆36Updated this week
- Trace AI applications and agents, and monitor token usage, cost, latency, and errors with OpenTelemetry.☆32Updated this week
- A powerful all-in-one Telegram bot for auto request approval, group management, moderation, filters, notes, force subscribe, and automati…☆17Oct 1, 2026Updated 2 weeks ago
- A Rust library for draping polygons over terrain with gfx☆11Mar 5, 2018Updated 8 years ago
- DeepSeek v4 Flash EXL3 on one DGX Spark☆347Aug 24, 2026Updated last month
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆17Updated this week
- CRUVI Standard Specifications☆21May 6, 2024Updated 2 years ago
- Compound V — a multi-model orchestrator for Claude Code, layered on Superpowers: a deterministic router (Opus for risky work, Sonnet for …☆40Oct 5, 2026Updated last week
- Bash script presents crontab in human readable form.☆11Apr 21, 2018Updated 8 years ago
- A Tutorial for tools developed on the DARPA CASE program☆16Oct 18, 2023Updated 3 years ago
- Reverse engineering analysis of DarkTortilla RAT, a sophisticated malware that steals credit card data, decrypts browser passwords, and e…☆49Sep 5, 2026Updated last month
- [EMNLP 2026] AgentCompass is an extensible open-source evaluation infrastructure for systematically assessing LLM/VLM agent capabilities.☆166Updated this week