Ongoing research training transformer models at scale
☆39May 1, 2026Updated this week
Alternatives and similar repositories for Megatron-LM
Users that are interested in Megatron-LM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- MAD (Model Automation and Dashboarding)☆35Updated this week
- ☆67Updated this week
- ☆11Jun 29, 2021Updated 4 years ago
- The goal of the OSSCI Fleet is to provide a central mechanism to enable test automation, batch job scheduling, and developer access to a …☆13Mar 24, 2026Updated last month
- Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more☆26Updated this week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆30Updated this week
- Fast and memory-efficient exact attention☆230Updated this week
- a small C++ lattice library☆15Jan 9, 2020Updated 6 years ago
- [DEPRECATED] Moved to ROCm/rocm-systems repo☆90Apr 1, 2026Updated last month
- A PyTorch native platform for training generative AI models☆17Apr 21, 2026Updated last week
- AI Tensor Engine for ROCm☆420Updated this week
- GPT2 Inference Implementation in Pure C☆32Jun 23, 2025Updated 10 months ago
- ☆24Oct 9, 2025Updated 6 months ago
- [DEPRECATED] Moved to ROCm/rocm-libraries repo☆113Updated this week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆20Sep 8, 2025Updated 7 months ago
- ☆65Updated this week
- Convenient access to `pynvml` (the library behind `nvidia-smi`)☆23Oct 18, 2024Updated last year
- [DEPRECATED] Moved to ROCm/rocm-systems repo☆29Apr 24, 2026Updated last week
- [DEPRECATED] Moved to ROCm/rocm-libraries repo. NOTE: develop branch is maintained as a read-only mirror☆529Updated this week
- Intel Gaudi's Megatron DeepSpeed Large Language Models for training☆18Dec 19, 2024Updated last year
- ☆75Updated this week
- Kubernetes operator which sets up all platform tools to have a cluster ready for applications to run.☆18Updated this week
- [DEPRECATED] Moved to ROCm/rocm-systems repo☆418Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Do not use averages with Likert scale data☆12Jul 26, 2017Updated 8 years ago
- pstore, a high-performance, read-optimized database system.☆26Nov 14, 2013Updated 12 years ago
- R Bindings for the UCR Suite for fast time series subsequence search☆17Mar 7, 2026Updated last month
- AMD RAD's multi-GPU Triton-based framework for seamless multi-GPU programming☆188Updated this week
- ROCm Documentation Python package for ReadTheDocs build standardization☆17Updated this week
- ☆164Updated this week
- Microsoft Collective Communication Library☆66Nov 23, 2024Updated last year
- Ongoing research training transformer models at scale☆18Jul 27, 2023Updated 2 years ago
- pycaret-powerbi-automl☆18Aug 4, 2020Updated 5 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- run commands in a container environment without root☆11Nov 1, 2016Updated 9 years ago
- Utilities for testing Kubernetes installations☆13Jan 16, 2018Updated 8 years ago
- The official repo of Pai-Megatron-Patch for LLM & VLM large scale training developed by Alibaba Cloud.☆1,563Dec 15, 2025Updated 4 months ago
- ☆30Updated this week
- A hierarchical collective communications library with portable optimizations☆38Dec 8, 2024Updated last year
- A curated list of Apache Pulsar resources☆13Oct 30, 2018Updated 7 years ago
- Codebase for Cuda Learning☆34Jul 13, 2024Updated last year