SGLang is a fast serving framework for large language models and vision language models.
☆34Oct 10, 2026Updated this week
Alternatives and similar repositories for sglang
Users that are interested in sglang are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- a simple API to use CUPTI☆10Aug 19, 2025Updated last year
- TiledLower is a Dataflow Analysis and Codegen Framework written in Rust.☆13Nov 23, 2024Updated last year
- ☆294Sep 5, 2026Updated last month
- Debug print operator for cudagraph debugging☆18Aug 2, 2024Updated 2 years ago
- Humming is a high-performance, lightweight, and highly flexible JIT (Just-In-Time) compiled GEMM kernel library specifically designed for…☆250Updated this week
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Handwritten GEMM using Intel AMX (Advanced Matrix Extension)☆17Jan 11, 2025Updated last year
- VNEC: A Vectorized Non-Empty Column Format for SpMV on cross-platform multicore CPUs☆10Feb 6, 2024Updated 2 years ago
- High performance RMSNorm Implement by using SM Core Storage(Registers and Shared Memory)☆31Jan 22, 2026Updated 8 months ago
- A memory-centric profiling tool suite for heterogeneous memory☆10Nov 13, 2024Updated last year
- Make FP4 on 5090 Great Again☆24Jul 20, 2026Updated 2 months ago
- Composable and Embeddable Communication Runtime for Distributed AI Services☆101Updated this week
- Profiling Spark Applications for Performance Comparison and Diagnosis☆16Nov 11, 2018Updated 7 years ago
- Tensara's GPU programming problems☆21Apr 23, 2026Updated 5 months ago
- Unified KV-cache compression for LLM inference: 12 Python-native methods, guarded add-on composition and routing, analytical capacity sim…☆28Aug 22, 2026Updated last month
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- FLA but cuTile☆27Apr 17, 2026Updated 5 months ago
- This repo hosts the famfs kernel patch sets as branches☆11Mar 24, 2026Updated 6 months ago
- ☆503Aug 26, 2026Updated last month
- the Stanford Transactional Applications for Multi-Processing; a benchmark suite for transactional memory research☆44Oct 1, 2021Updated 5 years ago
- Public repo for kernel writing skills in CuTeDSL, Triton, Tilelang and CUDA☆25Jul 7, 2026Updated 3 months ago
- ☆251Aug 26, 2026Updated last month
- Memory Sampling Tool using Linux perf_events☆15Aug 5, 2022Updated 4 years ago
- Lightweight performance and debugging tools☆17Feb 21, 2020Updated 6 years ago
- A C++ discrete event simulation framework☆15Mar 24, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A direct convolution library targeting ARM multi-core CPUs.☆12Nov 27, 2024Updated last year
- ☆13Mar 29, 2019Updated 7 years ago
- ☆21Jul 22, 2022Updated 4 years ago
- High-performance GPU kernels for Ads and Recsys model training, independently implemented and optimized for real-world workloads and mode…☆55Updated this week
- Automated High-Performance GPU Kernel Generation☆139Jun 1, 2026Updated 4 months ago
- The Splash-4 benchmark suite☆16Oct 26, 2023Updated 2 years ago
- A kernel module to enable RDMA transfers to/from IO, PFN and DAX mapped memory☆10Jun 23, 2015Updated 11 years ago
- [DEPRECATED] Moved to ROCm/rocm-systems repo☆94Sep 28, 2026Updated last week
- high-performance linear attention kernel library built on TileLang☆721Sep 30, 2026Updated last week
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Accelerating Multitask Training Trough Adaptive Transition [Efficient ML Model]☆12May 23, 2025Updated last year
- ☆49Apr 15, 2024Updated 2 years ago
- ☆12Oct 16, 2021Updated 4 years ago
- A set of common libraries for writing KubeVela ecosystem controllers.☆12Updated this week
- This is the implementation of our research system Illuminator that was published in ASPLOS 2018 with the title "Making Huge Pages Actuall…☆11Sep 11, 2020Updated 6 years ago
- Linux tree for ntrdma driver development.☆11Jun 29, 2017Updated 9 years ago
- Distributed Deep Graph Learning Framework for Dynamic Graphs☆19Mar 25, 2024Updated 2 years ago