SGLang is a fast serving framework for large language models and vision language models.
☆11Dec 15, 2025Updated 10 months ago
Alternatives and similar repositories for sglang
Users that are interested in sglang are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- PPoPP24 AGAThA: Fast and Efficient GPU Acceleration of Guided Sequence Alignment for Long Read Mapping☆22May 8, 2024Updated 2 years ago
- A High-Throughput Multi-GPU System for Graph-Based Approximate Nearest Neighbor Search☆21Jul 22, 2025Updated last year
- Boosting GPU utilization for LLM serving via dynamic spatial-temporal prefill & decode orchestration☆56Sep 23, 2026Updated last month
- This is the public repo for DREAM accepted to ICS 2025.☆12Dec 28, 2025Updated 10 months ago
- Compression for Foundation Models☆40Jul 21, 2025Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- ☆14Jan 20, 2025Updated last year
- [PACT'24] GraNNDis. A fast and unified distributed graph neural network (GNN) training framework for both full-batch (full-graph) and min…☆10Aug 13, 2024Updated 2 years ago
- Virtual Decoupled Cores: Composable Programming Framework and Runtime for Async GPUs☆25Updated this week
- ☆25Feb 12, 2025Updated last year
- 日麻牌理分析☆11Feb 9, 2026Updated 8 months ago
- Prefix-Aware Attention for LLM Decoding☆48May 26, 2026Updated 5 months ago
- Reference to Youtube Project on SpringBoot Login and Registration☆18Feb 24, 2018Updated 8 years ago
- ☆18Sep 27, 2026Updated last month
- ☆13Oct 6, 2024Updated 2 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Python CFFI Binding around SuiteSparse:GraphBLAS☆24Updated this week
- This project includes a simulator and workload generator for Edge-to-Cloud environments. Users can implement different scenarios, includi…☆16Aug 7, 2024Updated 2 years ago
- ☆92Oct 17, 2025Updated last year
- Repo to replay Qwen trace☆36Jan 9, 2026Updated 9 months ago
- Official repository for paper Routing-Free Mixture-of-Experts.☆19Aug 23, 2026Updated 2 months ago
- CUDA MoE kernels.☆12Sep 21, 2024Updated 2 years ago
- This is the repo of "SEP-Graph: Finding Shortest Execution Paths for Graph Processing under a Hybrid Framework on GPU"☆16Dec 11, 2018Updated 7 years ago
- （不再更新，请移步下面仓库）中国科学技术大学（USTC）计算机科学与技术课程相关（组合数学，计算机应用数学）以及其他方面的笔记。☆13Jan 18, 2026Updated 9 months ago
- Official implementation for paper "Navigating Labels and Vectors: A Unified Approach to Filtered Approximate Nearest Neighbor Search"☆38Dec 21, 2024Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆53Jul 27, 2026Updated 3 months ago
- 大模型API性能指标比较 - 深入分析TTFT、TPS等关键指标☆20Sep 12, 2024Updated 2 years ago
- ☆19Aug 16, 2025Updated last year
- ☆20Jun 23, 2024Updated 2 years ago
- ☆184Apr 23, 2026Updated 6 months ago
- ☆16Sep 25, 2025Updated last year
- Self Reproduction Code of Paper "Reducing Transformer Key-Value Cache Size with Cross-Layer Attention (MIT CSAIL)☆17May 24, 2024Updated 2 years ago
- OnlineJudge项目(YuJudge)的判题服务器，支持docker一键部署☆11May 27, 2023Updated 3 years ago
- [ICML 2025] Emergent Response Planning in LLMs☆21Jul 1, 2025Updated last year
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- SmartSSD related benchmarks and toy applications☆14Nov 1, 2023Updated 3 years ago
- Paper reading and discussion notes, covering AI frameworks, distributed systems, cluster management, etc.☆77Mar 4, 2026Updated 7 months ago
- Image masking basic techniques☆17Jun 22, 2022Updated 4 years ago
- ☆14Jul 13, 2025Updated last year
- AI model training on heterogeneous, geo-distributed resources☆47Nov 24, 2025Updated 11 months ago
- An open-source framework for building monolithic or distributed agentic systems, ranging from simple LLM calls to compositional workflows…☆32Jan 14, 2026Updated 9 months ago
- [OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable☆228Oct 14, 2026Updated 2 weeks ago