SparseServe: Unlocking Parallelism for Dynamic Sparse Attention in Long-Context LLM Serving
☆14Sep 30, 2025Updated last year
Alternatives and similar repositories for SparseServe
Users that are interested in SparseServe are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆19Aug 16, 2025Updated last year
- A high-throughput and memory-efficient inference and serving engine for LLMs☆11Sep 4, 2025Updated last year
- ☆13Oct 16, 2026Updated 3 weeks ago
- InfiniGen: Efficient Generative Inference of Large Language Models with Dynamic KV Cache Management (OSDI'24)☆196Jul 10, 2024Updated 2 years ago
- Official repository of: Attention Sinks in Diffusion Language Models☆12Dec 10, 2025Updated 11 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- [ACL 2026] Focus-dLLM: Accelerating Long-Context Diffusion LLM Inference via Confidence-Guided Context Focusing".☆14Nov 5, 2026Updated last week
- Recent papers and projects in multitask learning and their applications☆10Jul 20, 2026Updated 3 months ago
- [AAAI 2026] SlimInfer: Accelerating Long-Context LLM Inference via Dynamic Token Pruning☆13Nov 23, 2025Updated 11 months ago
- ☆14Nov 18, 2025Updated 11 months ago
- [VLDB 26, NeurIPS 25] Scalable long-context LLM decoding that leverages sparsity—by treating the KV cache as a vector storage system.☆157Sep 14, 2026Updated last month
- High-Speed Stateful Packet Processor for Programmable Switches☆13Dec 18, 2022Updated 3 years ago
- We introduce UltraLLaDA , a scaled variant of LLaDA-8B-Base that extends the context length up to 128K tokens with light-weight post-trai…☆15Oct 23, 2025Updated last year
- ☆20May 10, 2025Updated last year
- This is a fork of SGLang for hip-attention integration. Please refer to hip-attention for detail.☆18Mar 31, 2026Updated 7 months ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- ArkVale: Efficient Generative LLM Inference with Recallable Key-Value Eviction (NIPS'24)☆55Dec 17, 2024Updated last year
- a mllm inference engine for academic research☆24Jan 30, 2026Updated 9 months ago
- ☆34Jul 13, 2026Updated 4 months ago
- COSE: Configuring Serverless Functions using Statistical Learning☆10Jun 28, 2023Updated 3 years ago
- ☆11Oct 29, 2026Updated 2 weeks ago
- ☆11Updated this week
- Implementation of the Labelled Multi-Bernoulli Filter☆24Dec 23, 2023Updated 2 years ago
- Simulation code examples for the Massive MIMO blog☆21Mar 18, 2021Updated 5 years ago
- ☆13May 11, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆10Sep 14, 2023Updated 3 years ago
- Resource Multiplexing in Tuning and Serving Large Language Models (USENIX ATC 2025)☆10Apr 21, 2026Updated 6 months ago
- 蚂蚁开源技术沙龙演讲材料归档☆29Jun 16, 2026Updated 4 months ago
- a simple API to use CUPTI☆10Aug 19, 2025Updated last year
- A high-performance, universal serving framework for any-to-any models.☆113Updated this week
- Real_Time_Clock_With_Alarm☆15Sep 18, 2020Updated 6 years ago
- ☆12Nov 21, 2025Updated 11 months ago
- ☆21Nov 22, 2025Updated 11 months ago
- A lightweight CuTe-based CUDA kernel for DuoAttention, optimized for large language model inference.☆12Dec 25, 2025Updated 10 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆10Apr 14, 2026Updated 6 months ago
- Horizon area chart D3 component☆10Oct 14, 2026Updated 3 weeks ago
- Modular and structured prompt caching for low-latency LLM inference☆13May 12, 2024Updated 2 years ago
- Mini-SGLang is a mini version of SGLang project ().☆13Sep 24, 2025Updated last year
- Injecting Adrenaline into LLM Serving: Boosting Resource Utilization and Throughput via Attention Disaggregation☆43Oct 26, 2026Updated 2 weeks ago
- A scheduling framework for multitasking over diverse XPUs, including GPUs, NPUs, ASICs, and FPGAs☆14Jun 17, 2026Updated 4 months ago
- Reduce kernel based on CUTLASS CuTe and TMA.☆12Sep 25, 2025Updated last year
Are these results useful?