Ongoing research training transformer models at scale
☆37Feb 26, 2026Updated this week
Alternatives and similar repositories for Megatron-LM
Users that are interested in Megatron-LM are comparing it to the libraries listed below
Sorting:
- MAD (Model Automation and Dashboarding)☆31Updated this week
- ☆11Jun 29, 2021Updated 4 years ago
- ☆65Updated this week
- The goal of the OSSCI Fleet is to provide a central mechanism to enable test automation, batch job scheduling, and developer access to a …☆13Feb 18, 2026Updated last week
- Fast and memory-efficient exact attention☆221Updated this week
- ☆24Oct 9, 2025Updated 4 months ago
- [DEPRECATED] Moved to ROCm/rocm-systems repo☆86Feb 11, 2026Updated 2 weeks ago
- ☆30Updated this week
- [DEPRECATED] Moved to ROCm/rocm-systems repo☆29Updated this week
- Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more☆25Updated this week
- [DEPRECATED] Moved to ROCm/rocm-libraries repo☆113Updated this week
- ☆71Updated this week
- AI Tensor Engine for ROCm☆360Updated this week
- Artifacts of EVT ASPLOS'24☆29Mar 6, 2024Updated last year
- Create and deploy virtual-experiments - co-processing computational workflows☆10Jan 28, 2026Updated last month
- Microsoft Collective Communication Library☆66Nov 23, 2024Updated last year
- ☆157Updated this week
- CUDA Flux is a profiler for GPU applications which reports the basic block executions frequencies of compute kernels☆32Mar 15, 2021Updated 4 years ago
- Primus-SaFE(Stability and Fault Endurance)☆52Updated this week
- Kinematic and dynamic models of continuum and articulated soft robots.☆15Nov 22, 2025Updated 3 months ago
- ext_mpi_collectives☆11Apr 1, 2025Updated 11 months ago
- PARADIS, a lightweight and flexible weather forecast model that tries to Keep It Simple.☆26Feb 4, 2026Updated 3 weeks ago
- The System Stacks for Linux* OS are a collection of production ready docker images for Deep Learning, Media and Storage optimized for 2nd…☆34Jan 10, 2023Updated 3 years ago
- A hierarchical collective communications library with portable optimizations☆37Dec 8, 2024Updated last year
- pstore, a high-performance, read-optimized database system.☆26Nov 14, 2013Updated 12 years ago
- ☆14Apr 14, 2025Updated 10 months ago
- 2D time-domain isotropic (visco)elastic FD modeling and full waveform inversion (FWI) code for SH-waves☆13Aug 9, 2020Updated 5 years ago
- Argonne Leadership Computing Facility OpenCL tutorial☆10Aug 22, 2025Updated 6 months ago
- Code for the paper "Faster Neural Network Training with Approximate Tensor Operations"☆10Oct 23, 2021Updated 4 years ago
- An artificial matrix generator in C☆12Feb 16, 2023Updated 3 years ago
- OpenMP offload playground☆10Nov 16, 2024Updated last year
- GPU based 2D elastic FWI☆12Mar 6, 2018Updated 7 years ago
- BERT Sentiment Classification on the IMDb Large Movie Review Dataset.☆16Sep 8, 2022Updated 3 years ago
- ☆12Nov 17, 2020Updated 5 years ago
- ☆10Updated this week
- SMD-Lötstation mit Steuerung über ESP8266☆12Nov 3, 2020Updated 5 years ago
- How to build an ACP compliant agent that uses MCP as well!☆11May 6, 2025Updated 9 months ago
- Code for paper "Beyond Closure Models: Learning Chaotic Systems via Physics-Informed Neural Operators".☆14Dec 24, 2025Updated 2 months ago
- Kubernetes operator which sets up all platform tools to have a cluster ready for applications to run.☆17Updated this week