Alternatives and similar repositories for InfraGym

Users that are interested in InfraGym are comparing it to the libraries listed below

• ByteDance-Seed / StragglerAnalysis
  ☆49Updated 8 months ago
• microsoft / chunk-attention
  ☆84Updated 8 months ago
• project-etalon / etalon
  LLM Serving Performance Evaluation Harness
  ☆82Updated 10 months ago
• WukLab / preble
  Stateful LLM Serving
  ☆93Updated 9 months ago
• FlexFusion / FlexFusion
  The official implementation for the intra-stage fusion technique introduced in https://arxiv.org/abs/2409.13221
  ☆27Updated 8 months ago
• hao-ai-lab / vllm-ltr
  [NeurIPS 2024] Efficient LLM Scheduling by Learning to Rank
  ☆66Updated last year
• CalvinXKY / mfu_calculation
  A simple calculation for LLM MFU.
  ☆58Updated 3 months ago
• kvcache-ai / TrEnv-X
  ☆72Updated 3 months ago
• ModelTC / awesome-lm-system
  Summary of system papers/frameworks/codes/tools on training or serving large model
  ☆57Updated 2 years ago
• InternLM / turbomind
  ☆96Updated 9 months ago
• hao-ai-lab / DistCA
  Efficient Long-context Language Model Training by Core Attention Disaggregation
  ☆73Updated last week
• zhuzilin / flash-attention-with-sink
  ☆39Updated 5 months ago
• microsoft / ParrotServe
  [OSDI'24] Serving LLM-based Applications Efficiently with Semantic Variable
  ☆206Updated last year
• Gaffey / ExCP
  Official implementation of ICML 2024 paper "ExCP: Extreme LLM Checkpoint Compression via Weight-Momentum Joint Shrinking".
  ☆47Updated last year
• RLsys-Foundation / APRIL
  APRIL: Active Partial Rollouts in Reinforcement Learning to Tame Long-tail Generation. A system-level optimization for scalable LLM tra…
  ☆45Updated 2 months ago
• DeepLink-org / DLSlime
  DLSlime: Flexible & Efficient Heterogeneous Transfer Toolkit
  ☆91Updated this week
• microsoft / tokenweave
  Efficient Compute-Communication Overlap for Distributed LLM Inference
  ☆67Updated 2 months ago
• sgl-project / sgl-flash-attn
  Fast and memory-efficient exact attention
  ☆15Updated this week
• UbiquitousLearning / Paper-list-resource-efficient-large-language-model
  ☆102Updated last year
• infinigence / FUSCO
  High-performance distributed data shuffling (all-to-all) library for MoE training and inference
  ☆102Updated last week
• tile-ai / AttentionEngine
  ☆52Updated 7 months ago
• hao-ai-lab / MuxServe
  ☆81Updated 2 months ago
• ByteDance-Seed / ByteCheckpoint
  ByteCheckpoint: An Unified Checkpointing Library for LFMs
  ☆256Updated last month
• ruipeterpan / marconi
  Artifact for "Marconi: Prefix Caching for the Era of Hybrid LLMs" [MLSys '25 Outstanding Paper Award, Honorable Mention]
  ☆48Updated 10 months ago
• smart-lty / ParallelSpeculativeDecoding
  [ICLR 2025] PEARL: Parallel Speculative Decoding with Adaptive Draft Length
  ☆144Updated 2 weeks ago
• tile-ai / TileOPs
  ☆69Updated this week
• fzyzcjy / torch_utils
  Utility scripts for PyTorch (e.g. Make Perfetto show some disappearing kernels, Memory profiler that understands more low-level allocatio…
  ☆76Updated 3 months ago
• KuangjuX / NVSHMEM-Tutorial
  NVSHMEM‑Tutorial: Build a DeepEP‑like GPU Buffer
  ☆151Updated 3 months ago
• InternLM / Awesome-LLM-Training-System
  ☆45Updated last year
• flashinfer-ai / cutlass-viz
  ☆65Updated 8 months ago