Ongoing research training transformer models at scale
☆39Mar 20, 2026Updated this week
Alternatives and similar repositories for Megatron-LM
Users that are interested in Megatron-LM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- MAD (Model Automation and Dashboarding)☆32Updated this week
- ☆64Updated this week
- ☆11Jun 29, 2021Updated 4 years ago
- The goal of the OSSCI Fleet is to provide a central mechanism to enable test automation, batch job scheduling, and developer access to a …☆13Feb 27, 2026Updated 3 weeks ago
- Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more☆26Updated this week
- ☆11Mar 22, 2022Updated 4 years ago
- [DEPRECATED] Moved to ROCm/rocm-systems repo☆88Mar 5, 2026Updated 2 weeks ago
- A PyTorch native platform for training generative AI models☆16Nov 18, 2025Updated 4 months ago
- AI Tensor Engine for ROCm☆385Updated this week
- ☆24Oct 9, 2025Updated 5 months ago
- [DEPRECATED] Moved to ROCm/rocm-libraries repo☆113Updated this week
- ☆20Sep 8, 2025Updated 6 months ago
- ☆19Feb 25, 2026Updated 3 weeks ago
- CSS-LM: Contrastive Semi-supervised Fine-tuning of Pre-trained Language Models☆12Jul 1, 2023Updated 2 years ago
- Convenient access to `pynvml` (the library behind `nvidia-smi`)☆23Oct 18, 2024Updated last year
- ☆64Updated this week
- R package for unleashing the power of NVIDIA GPU's☆16Jun 4, 2016Updated 9 years ago
- [DEPRECATED] Moved to ROCm/rocm-systems repo☆29Updated this week
- [DEPRECATED] Moved to ROCm/rocm-libraries repo. NOTE: develop branch is maintained as a read-only mirror☆525Updated this week
- The Shifted and The Overlooked: A Task-oriented Investigation of User-GPT Interactions (EMNLP 2023))☆13Dec 21, 2023Updated 2 years ago
- Intel Gaudi's Megatron DeepSpeed Large Language Models for training☆18Dec 19, 2024Updated last year
- Kubernetes operator which sets up all platform tools to have a cluster ready for applications to run.☆17Updated this week
- [DEPRECATED] Moved to ROCm/rocm-systems repo☆413Updated this week
- ☆29Apr 4, 2024Updated last year
- Do not use averages with Likert scale data☆12Jul 26, 2017Updated 8 years ago
- ☆72Jun 20, 2025Updated 9 months ago
- Official implementation for the paper "Understanding Hyperdimensional Computing for Parallel Single-Pass Learning"☆23Jun 10, 2023Updated 2 years ago
- DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.☆14Jan 8, 2026Updated 2 months ago
- python package of rocm-smi-lib☆24Dec 15, 2025Updated 3 months ago
- Random collections of my interested research papers / projects☆20May 20, 2021Updated 4 years ago
- pstore, a high-performance, read-optimized database system.☆26Nov 14, 2013Updated 12 years ago
- R Bindings for the UCR Suite for fast time series subsequence search☆16Mar 7, 2026Updated 2 weeks ago
- ROCm Documentation Python package for ReadTheDocs build standardization☆16Mar 10, 2026Updated last week
- ☆160Mar 16, 2026Updated last week
- Microsoft Collective Communication Library☆66Nov 23, 2024Updated last year
- This is a PyTorch implementation of the paperViP A Differentially Private Foundation Model for Computer Vision☆36Jun 27, 2023Updated 2 years ago
- Azure HPC/AI VM Images☆128Updated this week
- ☆29Updated this week
- run commands in a container environment without root☆11Nov 1, 2016Updated 9 years ago