Alternatives and similar repositories for openmlsys-en

Users that are interested in openmlsys-en are comparing it to the libraries listed below

• fanlai0990 / CS598
  Systems for GenAI
  ☆157Updated last week
• flagos-ai / awesome-LLM-driven-kernel-generation
  Review automated kernel generation in the era of LLMs
  ☆91Updated 2 weeks ago
• linkedin / fmchisel
  fmchisel: Efficient Compression and Training Algorithms for Foundation Models
  ☆83Updated 3 months ago
• tspeterkim / paged-attention-minimal
  a minimal cache manager for PagedAttention, on top of llama3.
  ☆135Updated last year
• Infini-AI-Lab / MagicPIG
  [ICLR2025 Spotlight] MagicPIG: LSH Sampling for Efficient LLM Generation
  ☆248Updated last year
• EfficientMoE / MoE-Infinity
  PyTorch library for cost-effective, fast and easy serving of MoE models.
  ☆279Updated this week
• galeselee / Awesome_LLM_System-PaperList
  Since the emergence of chatGPT in 2022, the acceleration of Large Language Model has become increasingly important. Here is a list of pap…
  ☆283Updated 11 months ago
• sgl-project / sgl-learning-materials
  Materials for learning SGLang
  ☆738Updated last month
• interestingLSY / swiftLLM
  A tiny yet powerful LLM inference system tailored for researching purpose. vLLM-equivalent performance with only 2k lines of code (2% of …
  ☆313Updated 7 months ago
• lambda7xx / awesome-AI-system
  paper and its code for AI System
  ☆347Updated last month
• microsoft / ParrotServe
  [OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable
  ☆209Updated last year
• gpu-mode / triton-index
  Cataloging released Triton kernels.
  ☆292Updated 4 months ago
• microsoft / vidur
  A large-scale simulation framework for LLM inference
  ☆530Updated 6 months ago
• Shenggan / awesome-distributed-ml
  A curated list of awesome projects and papers for distributed training or inference
  ☆265Updated last year
• efeslab / fiddler
  [ICLR'25] Fast Inference of MoE Models with CPU-GPU Orchestration
  ☆260Updated last year
• osayamenja / FlashMoE
  Distributed MoE in a Single Kernel [NeurIPS '25]
  ☆190Updated last week
• meta-pytorch / torchcomms
  torchcomms: a modern PyTorch communications API
  ☆327Updated this week
• InternLM / turbomind
  ☆96Updated 10 months ago
• sgl-project / sglang-jax
  JAX backend for SGL
  ☆234Updated this week
• InternLM / Awesome-LLM-Training-System
  ☆47Updated last year
• sihyeong / Awesome-LLM-Inference-Engine
  ☆166Updated 2 months ago
• fzyzcjy / torch_memory_saver
  Allow torch tensor memory to be released and resumed later
  ☆216Updated 3 weeks ago
• yale-sys / prompt-cache
  Modular and structured prompt caching for low-latency LLM inference
  ☆110Updated last year
• microsoft / sarathi-serve
  A low-latency & high-throughput serving engine for LLMs
  ☆470Updated last month
• AmadeusChan / Awesome-LLM-System-Papers
  ☆628Updated 3 weeks ago
• taehokim20 / LLMem
  LLMem: GPU Memory Estimation for Fine-Tuning Pre-Trained LLMs
  ☆28Updated 8 months ago
• xlite-dev / ffpa-attn
  🤖FFPA: Extend FlashAttention-2 with Split-D, ~O(1) SRAM complexity for large headdim, 1.8x~3x↑🎉 vs SDPA EA.
  ☆250Updated this week
• hao-ai-lab / DistCA
  Efficient Long-context Language Model Training by Core Attention Disaggregation
  ☆87Updated last week
• RLsys-Foundation / TritonForge
  🔥 LLM-powered GPU kernel synthesis: Train models to convert PyTorch ops into optimized Triton kernels via SFT+RL. Multi-turn compilation…
  ☆116Updated 2 months ago
• mlc-ai / notebooks
  ☆222Updated last year