☆69Nov 4, 2024Updated last year
Alternatives and similar repositories for specexec
Users that are interested in specexec are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆32May 24, 2025Updated last year
- a libp2p-backed daemon wrapping the functionalities of go-libp2p for use in other languages☆12Feb 9, 2025Updated last year
- ☆49Jun 27, 2024Updated 2 years ago
- scalable and robust tree-based speculative decoding algorithm☆375Jan 28, 2025Updated last year
- ☆69Dec 3, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- [COLM 2024] TriForce: Lossless Acceleration of Long Sequence Generation with Hierarchical Speculative Decoding☆280Aug 31, 2024Updated 2 years ago
- Spec-Bench: A Comprehensive Benchmark and Unified Evaluation Platform for Speculative Decoding (ACL 2024 Findings)☆415Apr 22, 2025Updated last year
- Collaborative inference of latent diffusion via hivemind☆12May 29, 2023Updated 3 years ago
- Multi-Candidate Speculative Decoding☆40Apr 22, 2024Updated 2 years ago
- Libp2p bindings for Python☆12Jul 4, 2026Updated 3 months ago
- Code associated with the paper **Draft & Verify: Lossless Large Language Model Acceleration via Self-Speculative Decoding**☆230Feb 13, 2025Updated last year
- A source-to-source compiler for optimizing CUDA dynamic parallelism by aggregating launches☆15Jun 21, 2019Updated 7 years ago
- [ICLR2025] Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding☆161Dec 4, 2024Updated last year
- ☆28Mar 14, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A lightweight post-training framework for LLMs and VLMs. 51 algorithms, 38 verified models. Scales with DeepSpeed, vLLM, and Ray.☆20Aug 4, 2026Updated 2 months ago
- An Open-Source SCAlable Interface for ISA Extensionsfor RISC-V Processors. New Version:☆17Feb 29, 2024Updated 2 years ago
- [ACL 2025 main] FR-Spec: Frequency-Ranked Speculative Sampling☆56Jul 15, 2025Updated last year
- A framework for training-free asynchronous agents☆21Updated this week
- Official implementation of SPACE☆10May 19, 2024Updated 2 years ago
- [ICLR 2026] Rethinking Global Text Conditioning in Diffusion Transformers☆38Feb 9, 2026Updated 8 months ago
- ☆12Oct 13, 2025Updated last year
- PipeInfer: Accelerating LLM Inference using Asynchronous Pipelined Speculation☆33Nov 16, 2024Updated last year
- An Attention Superoptimizer☆22Jan 20, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- An innovative method expediting LLMs via streamlined semi-autoregressive generation and draft verification.☆29Apr 15, 2025Updated last year
- Scalable Edge-Assisted Serving Framework for Interactive LLMs [NeurIPS 2025 Spotlight]☆38Nov 14, 2025Updated 11 months ago
- Artifact Evaluation for SOSP 2025☆23Aug 16, 2025Updated last year
- Repository for the COLM 2025 paper SpecDec++: Boosting Speculative Decoding via Adaptive Candidate Lengths☆19Jul 10, 2025Updated last year
- The fastest off-the-shelf inference algorithm for LLMs (ICLR’25)☆14Mar 8, 2025Updated last year
- [NeurIPS 2025] Speculate Deep and Accurate☆25Aug 10, 2026Updated 2 months ago
- RISC-V ISA based 32-bit processor written in HLS☆16Nov 7, 2019Updated 6 years ago
- Repo for EmbedLLM: Learning Compact Representations of Large Language Models☆34Sep 25, 2025Updated last year
- Automatically Discovering Fast Parallelization Strategies for Distributed Deep Neural Network Training☆1,903Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆31Feb 3, 2026Updated 8 months ago
- (CVPR 2025) Switti: Designing Scale-Wise Transformers for Text-to-Image Synthesis☆206Jul 13, 2025Updated last year
- ☆21Apr 27, 2026Updated 6 months ago
- FlexFlow Serve: Low-Latency, High-Performance LLM Serving☆90Sep 15, 2025Updated last year
- [NeurIPS'2024] Invertible Consistency Distillation for Text-Guided Image Editing in Around 7 Steps☆100Jul 4, 2024Updated 2 years ago
- NeuroSpector: Dataflow and Mapping Optimizer for Deep Neural Network Accelerators☆23Mar 20, 2025Updated last year
- official code for GliDe with a CaPE☆21Aug 13, 2024Updated 2 years ago