DFlash: Block Diffusion for Flash Speculative Decoding
☆6,178Aug 18, 2026Updated 2 months ago
Alternatives and similar repositories for dflash
Users that are interested in dflash are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆397Apr 16, 2026Updated 6 months ago
- LLM speculative inference server for heterogeneous hardware & consumer GPUs☆2,934Updated this week
- Train speculative decoding models effortlessly and port them smoothly to SGLang serving.☆1,227Updated this week
- DeepSpec: a full-stack codebase for training and evaluating speculative decoding algorithms☆7,226Jul 9, 2026Updated 3 months ago
- TokenSpeed is a speed-of-light LLM inference engine.☆2,711Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- LMCache: Supercharge Your LLM with the Fastest KV Cache Layer☆12,114Updated this week
- SGLang is a high-performance serving framework for large language models and multimodal models.☆37,422Updated this week
- [ICLR 2026] ParoQuant: Pairwise Rotation Quantization for Efficient Reasoning LLM Inference☆345Aug 19, 2026Updated 2 months ago
- Lossless DFlash speculative decoding for MLX on Apple Silicon☆789Aug 20, 2026Updated last month
- Official Implementation of EAGLE-1 (ICML'24), EAGLE-2 (EMNLP'24), and EAGLE-3 (NeurIPS'25).☆2,556Feb 20, 2026Updated 8 months ago
- Exact speculative decoding on Apple Silicon, powered by MLX.☆390Apr 20, 2026Updated 6 months ago
- FlashKDA: high-performance Kimi Delta Attention kernels☆1,282Sep 1, 2026Updated last month
- A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM☆890Updated this week
- Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.☆78,217Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- high-performance linear attention kernel library built on TileLang☆728Updated this week
- [EMNLP2026 Main] Official implementation of “Domino: Decoupling Causal Modeling from Autoregressive Drafting in Speculative Decoding”.☆140Jul 25, 2026Updated 2 months ago
- FlashInfer: Kernel Library for LLM Serving☆6,705Updated this week
- A lightweight inference engine supporting speculative speculative decoding (SSD).☆1,015May 10, 2026Updated 5 months ago
- slime is an LLM training framework for RL Scaling.☆8,686Updated this week
- A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative…☆5,356Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆94,138Updated this week
- FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.☆14,574Updated this week
- A vector index built on TurboQuant, written in Rust with Python bindings☆17,405Oct 7, 2026Updated last week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Tile-Based Runtime for Ultra-Low-Latency LLM Inference☆1,869Sep 24, 2026Updated 3 weeks ago
- A self-improving RLM agent for coding workflows and long-running autonomous tasks.☆22,174Updated this week
- Domain-specific language designed to streamline the development of high-performance GPU/CPU/Accelerators kernels☆8,654Updated this week
- MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.☆5,639Updated this week
- DeepGEMM: clean and efficient BLAS kernel library on GPU☆8,980Updated this week
- Nano vLLM☆15,956Apr 26, 2026Updated 5 months ago
- A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.☆5,362May 17, 2026Updated 5 months ago
- Scale computer-use 2.0 with open-source drivers, cross-OS sandboxes, and benchmarks for training, evaluation, and data generation.☆30,202Updated this week
- SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformer☆9,401Updated this week
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Official inference framework for 1-bit LLMs☆41,206Jul 27, 2026Updated 2 months ago
- A framework for efficient model inference with omni-modality models☆7,253Updated this week
- The fastest way to run Qwen 3.8 Flash Next, Qwen 3.8 27B and Ternary Bonsai 2 27B on a Mac: 125 tok/s in OpenCode on an M5 Max, and a 27B…☆2,604Oct 10, 2026Updated last week
- DeepSeek 4 Flash and PRO local inference engine for Metal, CUDA and ROCm☆23,928Oct 8, 2026Updated last week
- 📑 PageIndex: Document Index for Vectorless, Reasoning-based RAG☆39,265Updated this week
- JetSpec: Breaking the Scaling Ceiling of Speculative Decoding with Causal Parallel Tree Drafting☆238Updated this week
- LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar☆22,905Updated this week