sgl-project / sglang-jaxLinks
JAX backend for SGL
☆191Updated this week
Alternatives and similar repositories for sglang-jax
Users that are interested in sglang-jax are comparing it to the libraries listed below
Sorting:
- Autonomous GPU Kernel Generation via Deep Agents☆179Updated this week
- Allow torch tensor memory to be released and resumed later☆184Updated last week
- ring-attention experiments☆160Updated last year
- ByteCheckpoint: An Unified Checkpointing Library for LFMs☆256Updated this week
- ☆262Updated this week
- extensible collectives library in triton☆91Updated 8 months ago
- Applied AI experiments and examples for PyTorch☆309Updated 3 months ago
- Utility scripts for PyTorch (e.g. Make Perfetto show some disappearing kernels, Memory profiler that understands more low-level allocatio…☆72Updated 3 months ago
- Collection of kernels written in Triton language☆173Updated 8 months ago
- Cataloging released Triton kernels.☆277Updated 3 months ago
- ☆96Updated last year
- Triton-based implementation of Sparse Mixture of Experts.☆253Updated 2 months ago
- Ship correct and fast LLM kernels to PyTorch☆126Updated this week
- PyTorch bindings for CUTLASS grouped GEMM.☆132Updated 6 months ago
- Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.☆302Updated this week
- Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serv…☆236Updated 2 weeks ago
- torchcomms: a modern PyTorch communications API☆302Updated this week
- Helpful kernel tutorials and examples for tile-based GPU programming☆202Updated last week
- ☆150Updated 11 months ago
- Fast low-bit matmul kernels in Triton☆407Updated 3 weeks ago
- Triton-based Symmetric Memory operators and examples☆65Updated last month
- Github mirror of trition-lang/triton repo.☆104Updated this week
- A minimal implementation of vllm.☆62Updated last year
- Building the Virtuous Cycle for AI-driven LLM Systems☆95Updated last week
- TPU inference for vLLM, with unified JAX and PyTorch support.☆192Updated this week
- DeeperGEMM: crazy optimized version☆73Updated 7 months ago
- a minimal cache manager for PagedAttention, on top of llama3.☆127Updated last year
- ☆97Updated 8 months ago
- kernels, of the mega variety☆623Updated 2 months ago
- Perplexity GPU Kernels☆536Updated last month