JAX backend for SGL
☆369Oct 26, 2026Updated this week
Alternatives and similar repositories for sglang-jax
Users that are interested in sglang-jax are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Moving to vllm-project/vllm-jax. TPU inference for vLLM, with unified JAX and PyTorch support.☆467Updated this week
- Tokamax: A GPU and TPU kernel library.☆321Updated this week
- SGLang's TorchTPU Plugin☆67Updated this week
- ☆154Updated this week
- Minimal yet performant LLM examples in pure JAX☆286Aug 23, 2026Updated 2 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- torchax is a PyTorch frontend for JAX. It gives JAX the ability to author JAX programs using familiar PyTorch syntax. It also provides JA…☆249Oct 22, 2026Updated last week
- ☆99Updated this week
- ☆136Updated this week
- TPUMS (TPU Microbenchmark Suite) is a modular, high-fidelity benchmarking and profiling framework designed to evaluate the compute, memor…☆37Updated this week
- A collection of megakernels for TPU☆173Oct 15, 2026Updated 2 weeks ago
- ☆27Sep 10, 2026Updated last month
- A simple, performant, and scalable Jax LLM!☆2,455Updated this week
- Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serv…☆332Oct 14, 2026Updated 2 weeks ago
- Miles is an enterprise-facing reinforcement learning framework for LLM and VLM post-training, forked from and co-evolving with slime.☆3,242Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A Lightweight LLM Post-Training Library☆2,501Updated this week
- Orbax provides common checkpointing and persistence utilities for JAX users☆540Updated this week
- Materials for learning SGLang☆898Jan 5, 2026Updated 9 months ago
- ☆393Updated this week
- JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs wel…☆470Jan 5, 2026Updated 9 months ago
- A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.☆5,471May 17, 2026Updated 5 months ago
- Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, T…☆522Updated this week
- Train speculative decoding models effortlessly and port them smoothly to SGLang serving.☆1,251Updated this week
- Microbenchmarking hyperparameter tuning for JAX functions.☆24Oct 9, 2026Updated 3 weeks ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A profiling and performance analysis tool for machine learning☆593Updated this week
- a Jax quantization library☆140Updated this week
- FlashInfer: Kernel Library for LLM Serving☆6,821Updated this week
- Convert StableHLO models into Apple Core ML format☆22Sep 12, 2026Updated last month
- High-performance large-scale embedding acceleration for JAX on Google TPU SparseCores.☆38Updated this week
- A machine learning compiler for GPUs, CPUs, and ML accelerators☆4,626Updated this week
- A Quirky Assortment of CuTe Kernels☆1,185Updated this week
- ☆113Updated this week
- JaxPP is a library for JAX that enables flexible MPMD pipeline parallelism for large-scale LLM training☆83Oct 16, 2026Updated 2 weeks ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Open ABI and FFI for Machine Learning Systems☆475Updated this week
- Accelerating MoE with IO and Tile-aware Optimizations☆785Aug 29, 2026Updated 2 months ago
- A Python-embedded DSL that makes it easy to write fast, scalable ML kernels with minimal boilerplate.☆977Updated this week
- ☆14Oct 20, 2026Updated last week
- Perplexity GPU Kernels☆614Nov 7, 2025Updated 11 months ago
- Distributed Compiler and Optimized Parallel Kernels☆1,576Sep 18, 2026Updated last month
- Home for "How To Scale Your Model", a short blog-style textbook about scaling LLMs on TPUs☆1,513Oct 19, 2026Updated last week