Alternatives and similar repositories for sglang-jax

Users that are interested in sglang-jax are comparing it to the libraries listed below

• ByteDance-Seed / ByteCheckpoint
  ByteCheckpoint: An Unified Checkpointing Library for LFMs
  ☆245Updated 2 months ago
• InternLM / turbomind
  ☆94Updated 5 months ago
• hao-ai-lab / vllm-ltr
  [NeurIPS 2024] Efficient LLM Scheduling by Learning to Rank
  ☆59Updated 10 months ago
• microsoft / ParrotServe
  [OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable
  ☆181Updated 11 months ago
• fzyzcjy / torch_memory_saver
  Allow torch tensor memory to be released and resumed later
  ☆133Updated last week
• flashinfer-ai / cutlass-viz
  ☆64Updated 4 months ago
• Multi-LLM / prism-research
  Research prototype of PRISM — a cost-efficient multi-LLM serving system with flexible time- and space-based GPU sharing.
  ☆27Updated last month
• CalvinXKY / mfu_calculation
  A simple calculation for LLM MFU.
  ☆44Updated last week
• stepfun-ai / StepMesh
  ☆291Updated 2 weeks ago
• sgl-project / genai-bench
  Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serv…
  ☆209Updated 2 weeks ago
• InternLM / Awesome-LLM-Training-System
  ☆42Updated last year
• ademeure / DeeperGEMM
  DeeperGEMM: crazy optimized version
  ☆70Updated 4 months ago
• KuangjuX / AttnLink
  An experimental communicating attention kernel based on DeepEP.
  ☆34Updated last month
• kvcache-ai / TrEnv-X
  ☆51Updated this week
• sgl-project / SpecForge
  Train speculative decoding models effortlessly and port them smoothly to SGLang serving.
  ☆400Updated this week
• interestingLSY / swiftLLM
  A tiny yet powerful LLM inference system tailored for researching purpose. vLLM-equivalent performance with only 2k lines of code (2% of …
  ☆264Updated 3 months ago
• microsoft / chunk-attention
  ☆78Updated 5 months ago
• ovg-project / kvcached
  kvcached: Elastic KV cache for dynamic GPU sharing and efficient multi-LLM inference.
  ☆91Updated this week
• KuangjuX / NVSHMEM-Tutorial
  NVSHMEM‑Tutorial: Build a DeepEP‑like GPU Buffer
  ☆100Updated this week
• sgl-project / awesome-sglang
  Make SGLang go brrr
  ☆29Updated last week
• fzyzcjy / torch_utils
  Utility scripts for PyTorch (e.g. Memory profiler that understands more low-level allocations such as NCCL)
  ☆52Updated last week
• madsys-dev / deepseekv2-profile
  ☆147Updated 6 months ago
• zhuzilin / flash-attention-with-sink
  ☆38Updated last month
• DeepLink-org / DLSlime
  DLSlime: Flexible & Efficient Heterogeneous Transfer Toolkit
  ☆62Updated this week
• antgroup / DeepXTrace
  DeepXTrace is a lightweight tool for precisely diagnosing slow ranks in DeepEP-based environments.
  ☆50Updated last week
• ISEEKYAN / mbridge
  Bridge Megatron-Core to Hugging Face/Reinforcement Learning
  ☆120Updated 2 weeks ago
• ByteDance-Seed / FlexPrefill
  Code for paper: [ICLR2025 Oral] FlexPrefill: A Context-Aware Sparse Attention Mechanism for Efficient Long-Sequence Inference
  ☆141Updated 4 months ago
• hao-ai-lab / MuxServe
  ☆71Updated last year
• tile-ai / AttentionEngine
  ☆50Updated 4 months ago
• microsoft / RetrievalAttention
  Scalable long-context LLM decoding that leverages sparsity—by treating the KV cache as a vector storage system.
  ☆80Updated 3 weeks ago