SpecOPD: Branch-parallel on-policy distillation for faster speculative decoding.
☆25Nov 3, 2026Updated this week
Alternatives and similar repositories for SpecOPD
Users that are interested in SpecOPD are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Nano vLLM☆15Jun 1, 2026Updated 5 months ago
- ☆13Nov 11, 2024Updated last year
- ☆12Aug 1, 2026Updated 3 months ago
- ⚡ Official code for “ReaDy: Recurrent States as Dynamic Context for Speculative Drafting in Hybrid Linear Attention Large Language Models…☆17Oct 15, 2026Updated 3 weeks ago
- [ICLR 2026] Mixing Importance with Diversity: Joint Optimization for KV Cache Compression in Large Vision-Language Models☆32Mar 21, 2026Updated 7 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Use Hermes Agent as the control plane for local coding agents like Codex, Kimi Code, Claude Code, OpenCode, and Gemini CLI.☆41Jul 22, 2026Updated 3 months ago
- [USENIX OSDI 2026] Revisiting Pipeline Parallelism for LLM Serving☆14Oct 30, 2026Updated last week
- Collect LLM Quantization related papers, data, repositories☆12Aug 27, 2024Updated 2 years ago
- [AAAI 2026] Global Compression Commander: Plug-and-Play Inference Acceleration for High-Resolution Large Vision-Language Models☆43Jan 27, 2026Updated 9 months ago
- Official Implement for Paper "Neural Krylov Iteration for Accelerating Linear System Solving"☆16May 6, 2025Updated last year
- LightningRL: Breaking the Accuracy–Parallelism Trade-off of Block-wise dLLMs via Reinforcement Learning☆33Apr 25, 2026Updated 6 months ago
- PyTorch code for our paper "Progressive Binarization with Semi-Structured Pruning for LLMs"☆12Jul 11, 2026Updated 3 months ago
- ☆20Dec 24, 2024Updated last year
- The official code repo and data hub of top_nsigma sampling strategy for LLMs.☆28Feb 11, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆14Oct 24, 2024Updated 2 years ago
- Understand your LLM before deploy☆36Updated this week
- ☆17Jul 13, 2026Updated 3 months ago
- ☆85Updated this week
- ☆13Sep 29, 2026Updated last month
- Code for the paper *Attention Drift: What Speculative Decoding Models Learn*.☆33May 12, 2026Updated 5 months ago
- The code of paper "Learning Rule-Induced Subgraph Representations for Inductive Relation Prediction" in NeurIPS 2023.☆14Nov 25, 2023Updated 2 years ago
- A novel template-free retrosynthesizer that can generate diverse sets of reactants for a desired product via discrete conditional variati…☆15Aug 7, 2022Updated 4 years ago
- DuoDecoding: Hardware-aware Heterogeneous Speculative Decoding with Dynamic Multi-Sequence Drafting☆20Mar 4, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆22Oct 21, 2025Updated last year
- MirrorPPR: Exemplar-Based Portrait Photo Retouching☆15Jul 7, 2026Updated 4 months ago
- ☆32Jun 29, 2026Updated 4 months ago
- [NeurIPS 2026] Two Halves are More than One: Phase-wise Velocity Distillation for Fast and High-Quality Image Generation☆14Oct 7, 2026Updated last month
- 2D and 3D Graph Calculator☆37Updated this week
- ☆10Dec 3, 2024Updated last year
- [ICLR 2026] SERE: Similarity-Based Expert Re-routing for Efficient Batch Decoding in MoE Models☆23Feb 4, 2026Updated 9 months ago
- T5 model optimized with FlexAttention☆14Sep 30, 2024Updated 2 years ago
- ☆11Oct 29, 2026Updated last week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- 🕵️♂️ ML project to identify malicious web payloads, aimed at boosting the effectiveness of WAFs and IDSs.☆15Apr 7, 2024Updated 2 years ago
- Scaling to Tens of Thousands of Test-Time Iterations with Loop-Native Attention Residuals☆12Oct 21, 2026Updated 2 weeks ago
- Res-SRDiff is a diffusion-based super-resolution framework for high-resolution MRI reconstruction, using residual shifting for faster, de…☆27Jul 19, 2025Updated last year
- The official repo of "Draft-OPD: On-Policy Distillation for Speculative Draft Models"☆84Sep 4, 2026Updated 2 months ago
- A static performance model for LLM inference: given (model, GPU, interconnect, workload), instantly answer VRAM feasibility, latency(TTFT…☆23Oct 6, 2026Updated last month
- ☆16Sep 2, 2026Updated 2 months ago
- ☆14Oct 12, 2024Updated 2 years ago