SGLang wheels for multiple platforms
☆11Oct 13, 2025Updated last year
Alternatives and similar repositories for sgl-whl
Users that are interested in sgl-whl are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- SGLang Kernel Wheel Index☆26Updated this week
- Efficient and unified implementations for TopK-based sparse attention☆41Jul 10, 2026Updated 3 months ago
- Benchmark tests supporting the TiledCUDA library.☆19Nov 19, 2024Updated last year
- Cookbook of SGLang - Recipe☆10May 5, 2026Updated 5 months ago
- ☆65Apr 26, 2025Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- An experimental communicating attention kernel based on DeepEP.☆34Jul 29, 2025Updated last year
- ☆157Aug 18, 2025Updated last year
- ☆37Aug 7, 2025Updated last year
- The repository contains a reference end-to-end pipeline for a real-time video analytics application. Realtime data is provided to an infe…☆12Nov 3, 2025Updated 11 months ago
- FLA but cuTile☆27Apr 17, 2026Updated 6 months ago
- Automated CUDA kernel performance diagnostics from NVIDIA Nsight Compute (NCU) CSV exports.☆35Mar 18, 2026Updated 7 months ago
- Quantized Attention on GPU☆45Nov 22, 2024Updated last year
- a size profiler for cuda binary☆74Oct 3, 2026Updated 3 weeks ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆17Jun 3, 2024Updated 2 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- A repository of Dockerfiles, scripts, yaml files, Helm Charts, etc. used to build and scale the sample AI workflows with python, kubernet…☆12Feb 22, 2024Updated 2 years ago
- Fast and memory-efficient exact attention☆23Updated this week
- ☆32Jul 2, 2025Updated last year
- FA4-based Relative Attention Kernel developed by TML and Colfax☆18Sep 11, 2026Updated last month
- Autonomous GPU kernel optimization system driven by AI agents.☆32Mar 29, 2026Updated 7 months ago
- ☆25Apr 5, 2026Updated 6 months ago
- Inference Llama 2 with a model compiled to native code by TorchInductor☆14Feb 8, 2024Updated 2 years ago
- 使用 cutlass 仓库在 ada 架构上实现 fp8 的 flash attention☆83Aug 12, 2024Updated 2 years ago
- Debug print operator for cudagraph debugging☆18Aug 2, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Handwritten GEMM using Intel AMX (Advanced Matrix Extension)☆17Jan 11, 2025Updated last year
- ☆28Jun 8, 2026Updated 4 months ago
- ☆98Mar 26, 2025Updated last year
- ☆92Jan 23, 2025Updated last year
- Multiple GEMM operators are constructed with cutlass to support LLM inference.☆20Aug 3, 2025Updated last year
- A Triton JIT runtime and ffi provider in C++☆41Sep 24, 2026Updated last month
- DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling☆47Updated this week
- ☆40Dec 14, 2025Updated 10 months ago
- Shor's algorithm simulation using CUDA☆20Nov 10, 2019Updated 6 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Framework to reduce autotune overhead to zero for well known deployments.☆101Sep 19, 2025Updated last year
- Unified tracing profiler and visualizer, one timeline from CPU to GPU/HES to in-kernel zones☆149Sep 21, 2026Updated last month
- A text-to-network representation and semantic parsing toolkit.☆11Nov 11, 2019Updated 6 years ago
- A dynamic binary instrumentation tool for tracing and analyzing GPU kernel instructions.☆84Updated this week
- study of cutlass☆22Nov 10, 2024Updated last year
- ☆54May 19, 2025Updated last year
- Intel® Tensor Processing Primitives extension for Pytorch*☆20Aug 24, 2026Updated 2 months ago