Alternatives and similar repositories for mini-sglang

Users that are interested in mini-sglang are comparing it to the libraries listed below

• perplexityai / pplx-kernels
  Perplexity GPU Kernels
  ☆539Updated last month
• HazyResearch / Megakernels
  kernels, of the mega variety
  ☆631Updated 2 months ago
• radixark / miles
  ☆610Updated this week
• sgl-project / sgl-learning-materials
  Materials for learning SGLang
  ☆682Updated 2 weeks ago
• NVIDIA / kvpress
  LLM KV cache compression made easy
  ☆717Updated this week
• Dao-AILab / quack
  A Quirky Assortment of CuTe Kernels
  ☆687Updated last week
• SiriusNEO / Triton-Puzzles-Lite
  Puzzles for learning Triton, play it with minimal environment configuration!
  ☆571Updated 2 weeks ago
• ScalingIntelligence / KernelBench
  KernelBench: Can LLMs Write GPU Kernels? - Benchmark with Torch -> CUDA (+ more DSLs)
  ☆708Updated this week
• sgl-project / SpecForge
  Train speculative decoding models effortlessly and port them smoothly to SGLang serving.
  ☆557Updated this week
• gpu-mode / triton-index
  Cataloging released Triton kernels.
  ☆277Updated 3 months ago
• sgl-project / sglang-jax
  JAX backend for SGL
  ☆200Updated this week
• ByteDance-Seed / ByteCheckpoint
  ByteCheckpoint: An Unified Checkpointing Library for LFMs
  ☆256Updated last week
• ByteDance-Seed / Triton-distributed
  Distributed Compiler based on Triton for Parallel Systems
  ☆1,280Updated this week
• fzyzcjy / torch_memory_saver
  Allow torch tensor memory to be released and resumed later
  ☆187Updated 2 weeks ago
• efeslab / Nanoflow
  A throughput-oriented high-performance serving framework for LLMs
  ☆923Updated last month
• microsoft / vattention
  Dynamic Memory Management for Serving LLMs without PagedAttention
  ☆448Updated 6 months ago
• MoonshotAI / checkpoint-engine
  Checkpoint-engine is a simple middleware to update model weights in LLM inference engines
  ☆864Updated last week
• sgl-project / genai-bench
  Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serv…
  ☆247Updated last week
• MekkCyber / CutlassAcademy
  A curated collection of resources, tutorials, and best practices for learning and mastering NVIDIA CUTLASS
  ☆244Updated 7 months ago
• deepseek-ai / LPLB
  An early research stage expert-parallel load balancer for MoE models based on linear programming.
  ☆469Updated last month
• sail-sg / zero-bubble-pipeline-parallelism
  Zero Bubble Pipeline Parallelism
  ☆440Updated 7 months ago
• Deep-Learning-Profiling-Tools / triton-viz
  ☆262Updated last week
• tspeterkim / paged-attention-minimal
  a minimal cache manager for PagedAttention, on top of llama3.
  ☆127Updated last year
• pytorch / helion
  A Python-embedded DSL that makes it easy to write fast, scalable ML kernels with minimal boilerplate.
  ☆679Updated last week
• zhuzilin / ring-flash-attention
  Ring attention implementation with flash attention
  ☆944Updated 3 months ago
• NVIDIA / Star-Attention
  Efficient LLM Inference over Long Sequences
  ☆393Updated 5 months ago
• thinking-machines-lab / batch_invariant_ops
  ☆937Updated last month
• meta-pytorch / tritonbench
  Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.
  ☆301Updated this week
• andrewkchan / yalm
  Yet Another Language Model: LLM inference in C++/CUDA, no libraries except for I/O
  ☆539Updated 3 months ago
• interestingLSY / swiftLLM
  A tiny yet powerful LLM inference system tailored for researching purpose. vLLM-equivalent performance with only 2k lines of code (2% of …
  ☆297Updated 6 months ago