Alternatives and similar repositories for MegatronApp

Users that are interested in MegatronApp are comparing it to the libraries listed below

• CalvinXKY / mfu_calculation
  A simple calculation for LLM MFU.
  ☆50Updated 3 months ago
• ByteDance-Seed / ByteCheckpoint
  ByteCheckpoint: An Unified Checkpointing Library for LFMs
  ☆256Updated last week
• InternLM / turbomind
  ☆97Updated 8 months ago
• antgroup / DeepXTrace
  DeepXTrace is a lightweight tool for precisely diagnosing slow ranks in DeepEP-based environments.
  ☆73Updated this week
• sgl-project / genai-bench
  Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serv…
  ☆247Updated this week
• fzyzcjy / torch_memory_saver
  Allow torch tensor memory to be released and resumed later
  ☆187Updated 2 weeks ago
• ISEEKYAN / mbridge
  Bridge Megatron-Core to Hugging Face/Reinforcement Learning
  ☆172Updated this week
• rlite-project / RLite
  A lightweight reinforcement learning framework that integrates seamlessly into your codebase, empowering developers to focus on algorithm…
  ☆91Updated 3 months ago
• fzyzcjy / torch_utils
  Utility scripts for PyTorch (e.g. Make Perfetto show some disappearing kernels, Memory profiler that understands more low-level allocatio…
  ☆72Updated 3 months ago
• inclusionAI / asystem-amem
  A NCCL extension library, designed to efficiently offload GPU memory allocated by the NCCL communication library.
  ☆58Updated 2 weeks ago
• feifeibear / Odysseus-Transformer
  Odysseus: Playground of LLM Sequence Parallelism
  ☆78Updated last year
• alibaba / easydist
  Automated Parallelization System and Infrastructure for Multiple Ecosystems
  ☆81Updated last year
• RulinShao / LightSeq
  Official repository for DistFlashAttn: Distributed Memory-efficient Attention for Long-context LLMs Training
  ☆219Updated last year
• stepfun-ai / StepMesh
  ☆329Updated last month
• Victarry / PP-Schedule-Visualization
  Pipeline Parallelism Emulation and Visualization
  ☆72Updated 6 months ago
• microsoft / chunk-attention
  ☆82Updated 7 months ago
• inclusionAI / asystem-awex
  A high-performance RL training-inference weight synchronization framework, designed to enable second-level parameter updates from trainin…
  ☆109Updated last week
• feifeibear / LLMRoofline
  Compare different hardware platforms via the Roofline Model for LLM inference tasks.
  ☆119Updated last year
• ademeure / DeeperGEMM
  DeeperGEMM: crazy optimized version
  ☆73Updated 7 months ago
• meta-pytorch / KernelAgent
  Autonomous GPU Kernel Generation via Deep Agents
  ☆179Updated this week
• vllm-project / flash-attention
  Fast and memory-efficient exact attention
  ☆104Updated this week
• nex-agi / NexVenusCL
  Nex Venus Communication Library
  ☆64Updated 3 weeks ago
• fanshiqing / grouped_gemm
  PyTorch bindings for CUTLASS grouped GEMM.
  ☆172Updated 2 months ago
• sgl-project / SpecForge
  Train speculative decoding models effortlessly and port them smoothly to SGLang serving.
  ☆539Updated this week
• microsoft / AttentionEngine
  ☆114Updated 6 months ago
• NVIDIA-NeMo / Megatron-Bridge
  HuggingFace conversion and training library for Megatron-based models
  ☆270Updated this week
• hao-ai-lab / LookaheadReasoning
  [NeurIPS 2025] Scaling Speculative Decoding with Lookahead Reasoning
  ☆56Updated last month
• KuangjuX / NVSHMEM-Tutorial
  NVSHMEM‑Tutorial: Build a DeepEP‑like GPU Buffer
  ☆146Updated 2 months ago
• feifeibear / DPSKV3MFU
  Estimate MFU for DeepSeekV3
  ☆26Updated 11 months ago
• project-etalon / etalon
  LLM Serving Performance Evaluation Harness
  ☆82Updated 9 months ago