Alternatives and similar repositories for MegatronApp

Users that are interested in MegatronApp are comparing it to the libraries listed below

• InternLM / turbomind
  ☆96Updated 9 months ago
• ByteDance-Seed / ByteCheckpoint
  ByteCheckpoint: An Unified Checkpointing Library for LFMs
  ☆256Updated last month
• inclusionAI / asystem-amem
  A NCCL extension library, designed to efficiently offload GPU memory allocated by the NCCL communication library.
  ☆77Updated 3 weeks ago
• antgroup / DeepXTrace
  DeepXTrace is a lightweight tool for precisely diagnosing slow ranks in DeepEP-based environments.
  ☆83Updated 2 weeks ago
• fzyzcjy / torch_memory_saver
  Allow torch tensor memory to be released and resumed later
  ☆196Updated last month
• sgl-project / genai-bench
  Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serv…
  ☆250Updated 3 weeks ago
• CalvinXKY / mfu_calculation
  A simple calculation for LLM MFU.
  ☆58Updated 3 months ago
• hao-ai-lab / DistCA
  Efficient Long-context Language Model Training by Core Attention Disaggregation
  ☆73Updated last week
• nex-agi / NexVenusCL
  Nex Venus Communication Library
  ☆68Updated last month
• microsoft / AttentionEngine
  ☆116Updated 7 months ago
• stepfun-ai / StepMesh
  ☆337Updated this week
• Infini-AI-Lab / MagicDec
  [ICLR2025] Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding
  ☆135Updated last year
• feifeibear / Odysseus-Transformer
  Odysseus: Playground of LLM Sequence Parallelism
  ☆79Updated last year
• microsoft / tokenweave
  Efficient Compute-Communication Overlap for Distributed LLM Inference
  ☆67Updated 2 months ago
• fzyzcjy / torch_utils
  Utility scripts for PyTorch (e.g. Make Perfetto show some disappearing kernels, Memory profiler that understands more low-level allocatio…
  ☆73Updated 3 months ago
• Victarry / PP-Schedule-Visualization
  Pipeline Parallelism Emulation and Visualization
  ☆74Updated 6 months ago
• meta-pytorch / KernelAgent
  Autonomous GPU Kernel Generation via Deep Agents
  ☆197Updated last week
• feifeibear / DPSKV3MFU
  Estimate MFU for DeepSeekV3
  ☆26Updated last year
• microsoft / chunk-attention
  ☆84Updated 8 months ago
• flashinfer-ai / cutlass-viz
  ☆65Updated 8 months ago
• ISEEKYAN / mbridge
  Bridge Megatron-Core to Hugging Face/Reinforcement Learning
  ☆177Updated 2 weeks ago
• DeepLink-org / DLSlime
  DLSlime: Flexible & Efficient Heterogeneous Transfer Toolkit
  ☆91Updated this week
• infinigence / FUSCO
  High-performance distributed data shuffling (all-to-all) library for MoE training and inference
  ☆102Updated last week
• RulinShao / LightSeq
  Official repository for DistFlashAttn: Distributed Memory-efficient Attention for Long-context LLMs Training
  ☆220Updated last year
• alibaba / easydist
  Automated Parallelization System and Infrastructure for Multiple Ecosystems
  ☆82Updated last year
• fanshiqing / grouped_gemm
  PyTorch bindings for CUTLASS grouped GEMM.
  ☆178Updated 3 weeks ago
• kvcache-ai / TrEnv-X
  ☆72Updated 3 months ago
• madsys-dev / deepseekv2-profile
  ☆153Updated 10 months ago
• ademeure / DeeperGEMM
  DeeperGEMM: crazy optimized version
  ☆74Updated 8 months ago
• tile-ai / AttentionEngine
  ☆52Updated 7 months ago