Ongoing research training transformer models at scale
☆39Apr 9, 2026Updated this week
Alternatives and similar repositories for Megatron-LM
Users that are interested in Megatron-LM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- MAD (Model Automation and Dashboarding)☆33Updated this week
- ☆66Apr 4, 2026Updated last week
- ☆11Jun 29, 2021Updated 4 years ago
- The goal of the OSSCI Fleet is to provide a central mechanism to enable test automation, batch job scheduling, and developer access to a …☆13Mar 24, 2026Updated 2 weeks ago
- ☆30Updated this week
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting with the flexibility to host WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Cloudways by DigitalOcean.
- [ICML 2024] SPP: Sparsity-Preserved Parameter-Efficient Fine-Tuning for Large Language Models☆22May 28, 2024Updated last year
- Fast and memory-efficient exact attention☆227Updated this week
- ☆12Mar 22, 2022Updated 4 years ago
- a small C++ lattice library☆15Jan 9, 2020Updated 6 years ago
- ☆61Sep 15, 2023Updated 2 years ago
- [DEPRECATED] Moved to ROCm/rocm-systems repo☆89Apr 1, 2026Updated last week
- A PyTorch native platform for training generative AI models☆16Nov 18, 2025Updated 4 months ago
- AI Tensor Engine for ROCm☆402Updated this week
- ☆24Oct 9, 2025Updated 6 months ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- [DEPRECATED] Moved to ROCm/rocm-libraries repo☆112Updated this week
- ☆19Feb 25, 2026Updated last month
- CSS-LM: Contrastive Semi-supervised Fine-tuning of Pre-trained Language Models☆12Jul 1, 2023Updated 2 years ago
- The official implementation of ImageBind-LLM and Whisper-LLM from the paper "Dynamic-SUPERB: Towards A Dynamic, Collaborative, and Compre…☆21Oct 30, 2023Updated 2 years ago
- Convenient access to `pynvml` (the library behind `nvidia-smi`)☆23Oct 18, 2024Updated last year
- R package for unleashing the power of NVIDIA GPU's☆16Jun 4, 2016Updated 9 years ago
- [DEPRECATED] Moved to ROCm/rocm-systems repo☆29Updated this week
- [DEPRECATED] Moved to ROCm/rocm-libraries repo. NOTE: develop branch is maintained as a read-only mirror☆525Apr 3, 2026Updated last week
- Intel Gaudi's Megatron DeepSpeed Large Language Models for training☆18Dec 19, 2024Updated last year
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Kubernetes operator which sets up all platform tools to have a cluster ready for applications to run.☆18Updated this week
- [DEPRECATED] Moved to ROCm/rocm-systems repo☆416Updated this week
- ☆29Apr 4, 2024Updated 2 years ago
- ☆74Jun 20, 2025Updated 9 months ago
- DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.☆14Jan 8, 2026Updated 3 months ago
- python package of rocm-smi-lib☆24Dec 15, 2025Updated 3 months ago
- Random collections of my interested research papers / projects☆20May 20, 2021Updated 4 years ago
- R Bindings for the UCR Suite for fast time series subsequence search☆17Mar 7, 2026Updated last month
- Microsoft Collective Communication Library☆66Nov 23, 2024Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- ☆11Jun 24, 2021Updated 4 years ago
- Ongoing research training transformer models at scale☆18Jul 27, 2023Updated 2 years ago
- Azure HPC/AI VM Images☆128Updated this week
- run commands in a container environment without root☆11Nov 1, 2016Updated 9 years ago
- A set of examples around pytorch in Vision, Text, Reinforcement Learning, etc.☆12Oct 12, 2018Updated 7 years ago
- A hierarchical collective communications library with portable optimizations☆37Dec 8, 2024Updated last year
- Codebase for Cuda Learning☆33Jul 13, 2024Updated last year