Ongoing research training transformer models at scale
☆43Jul 21, 2026Updated this week
Alternatives and similar repositories for Megatron-LM
Users that are interested in Megatron-LM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆72Updated this week
- A practical guide to high-performance gluon kernel development on AMD GFX9 GPUs.☆38Updated this week
- AI Tensor Engine for ROCm☆497Updated this week
- ☆30Jun 16, 2026Updated last month
- Fast and memory-efficient exact attention☆234Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- The goal of the OSSCI Fleet is to provide a central mechanism to enable test automation, batch job scheduling, and developer access to a …☆13Apr 28, 2026Updated 2 months ago
- A high-performance acceleration library dedicated to large-scale model training on AMD GPUs☆67Updated this week
- ☆81Updated this week
- Primus-SaFE(Stability and Fault Endurance)☆56Updated this week
- ☆34Updated this week
- [ICML 2024] SPP: Sparsity-Preserved Parameter-Efficient Fine-Tuning for Large Language Models☆22May 28, 2024Updated 2 years ago
- Repository with examples and exercises for OLCF and AMD's HIP training series☆17Oct 16, 2023Updated 2 years ago
- ☆12Mar 22, 2022Updated 4 years ago
- [DEPRECATED] Moved to ROCm/rocm-systems repo☆92Jul 14, 2026Updated last week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆61Sep 15, 2023Updated 2 years ago
- Automating analysis from trace files☆81Updated this week
- Scale-out system monitoring☆25Updated this week
- AI Workload Orchestrator for Kubernetes☆23Jul 10, 2026Updated last week
- [DEPRECATED] Moved to ROCm/rocm-libraries repo. NOTE: develop branch is maintained as a read-only mirror☆538Updated this week
- ☆26Oct 9, 2025Updated 9 months ago
- Modular RDMA Interface☆153Updated this week
- [DEPRECATED] Moved to ROCm/rocm-libraries repo☆114Updated this week
- Examples illustrating usage of the rocBLAS library☆17Aug 12, 2024Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆20Sep 8, 2025Updated 10 months ago
- A PyTorch native platform for training generative AI models☆17Jun 30, 2026Updated 3 weeks ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆122Updated this week
- [DEPRECATED] Moved to ROCm/rocm-systems repo☆419Updated this week
- The official implementation of ImageBind-LLM and Whisper-LLM from the paper "Dynamic-SUPERB: Towards A Dynamic, Collaborative, and Compre…☆21Oct 30, 2023Updated 2 years ago
- The official repo of Pai-Megatron-Patch for LLM & VLM large scale training developed by Alibaba Cloud.☆1,585Dec 15, 2025Updated 7 months ago
- [DEPRECATED] Moved to ROCm/rocm-systems repo☆146Updated this week
- Simplified packaging for pybind11-based C++ extensions☆13Jun 3, 2022Updated 4 years ago
- python package of rocm-smi-lib☆25Dec 15, 2025Updated 7 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- 信贷申请评分☆10Apr 1, 2020Updated 6 years ago
- Muon in Int8 Precision Made Possible☆20Jun 18, 2026Updated last month
- A ROCm library for GPU-Initiated IO. This provides support for initiating IO from a ROCm-capable GPU against a range of targets including…☆52Jul 10, 2026Updated last week
- ☆104Updated this week
- Provides the examples to write and build Habana custom kernels using the HabanaTools☆26Apr 15, 2025Updated last year
- Intel Gaudi's Megatron DeepSpeed Large Language Models for training☆18Dec 19, 2024Updated last year
- The tool facilitates debugging convergence issues and testing new algorithms and recipes for training LLMs using Nvidia libraries such as…☆21Sep 17, 2025Updated 10 months ago