Ongoing research training transformer language models at scale, including: BERT & GPT-2
☆17Sep 18, 2026Updated 2 months ago
Alternatives and similar repositories for Megatron-DeepSpeed
Users that are interested in Megatron-DeepSpeed are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A simple tool for launching ensembles☆12Updated this week
- Cosmic Tagging Network for Neutrino Physics☆13Aug 22, 2026Updated 3 months ago
- The ALCF hosts a regular simulation, data, and learning workshop to help users scale their applications. This repository contains the exa…☆75Dec 17, 2025Updated 11 months ago
- ☆47Jul 17, 2025Updated last year
- This is a repository with examples to run inference endpoints on various ALCF clusters☆30Nov 10, 2026Updated last week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ALCF Systems User Documentation☆31Updated this week
- AI Accelerators-SC23-tutorial Repository☆12Nov 12, 2023Updated 3 years ago
- ☆242Nov 9, 2026Updated last week
- VaniDL is an tool for analyzing I/O patterns and behavior with Deep Learning Applications.☆10Jul 8, 2022Updated 4 years ago
- Assignments of CSCE-642: Deep Reinforcement Learning offered at Texas A&M University.☆13Oct 8, 2026Updated last month
- Example applications for the Department of Energy Computational Science Graduate Fellowship☆27Sep 8, 2026Updated 2 months ago
- Add ipython magic to call python trepan☆14Aug 23, 2020Updated 6 years ago
- Code repository for "Prioritizing Repurposable Drugs for SARS-CoV-2 using Deep Learning and Population-based Validation"☆16May 2, 2025Updated last year
- Python bindings for NVIDIA CUDA APIs.☆14Mar 2, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Deep Learning at Scale Training Event at NERSC☆23Jun 5, 2025Updated last year
- Collection of small examples for running on ALCF resources☆25Oct 6, 2026Updated last month
- Distributed Training of Bayesian Neural Networks at Scale☆11May 26, 2020Updated 6 years ago
- Material for the SC22 Deep Learning at Scale Tutorial☆41Jul 14, 2023Updated 3 years ago
- virtual node analysis on ogb benchmark dataset☆14Mar 9, 2023Updated 3 years ago
- Pocket Survival Guide for Sys Admin - http://psg.skinforum.org/ -☆15Nov 12, 2026Updated last week
- Optimized primitives for collective multi-GPU communication☆11May 8, 2024Updated 2 years ago
- scalable data movement in Exascale Supercomputers☆19Updated this week
- Liquid Argon Computer Vision☆12Dec 4, 2025Updated 11 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Shrink your video by limiting the quality☆14Sep 26, 2022Updated 4 years ago
- A lattice QCD library.☆17Updated this week
- Write once, run anywhere; ezpz 🍋☆44Updated this week
- 8x8x8 Circles or Spheres drawn in OpenGL in Qt, based off the grabber example. See the pendulum repo, too.☆12Mar 4, 2015Updated 11 years ago
- Tools and pipelines for automated LLM performance evaluation☆15May 20, 2026Updated 6 months ago
- Adaptive Parallel PDF Parsing and Resource Scaling Engine☆67Dec 17, 2025Updated 11 months ago
- ☆11Dec 12, 2019Updated 6 years ago
- Basic notebook checks. Do they run? Do they contain lint?☆17Sep 26, 2025Updated last year
- An attempt to fix the light-themed webpages!☆14Feb 7, 2018Updated 8 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- LLM checkpointing for DeepSpeed/Megatron☆27Nov 30, 2025Updated 11 months ago
- EfficientNet-L2 weights in Keras and retrieval script modified from qubvel/efficientnet☆24Mar 25, 2021Updated 5 years ago
- This repository contains the SwinV2_Weather model, developed for the "Analyzing and Exploring Training Recipes for Large-Scale Transforme…☆22Oct 8, 2024Updated 2 years ago
- ☆88Mar 17, 2025Updated last year
- E4S à la carte is a tool that allows a user to customize a container image by adding packages to it. These can be system packages and Spa…☆10Aug 15, 2025Updated last year
- A tracing infrastructure for heterogeneous computing applications.☆43Nov 15, 2026Updated last week
- Scaling RLLib for generic simulation environments on Theta☆20Feb 16, 2023Updated 3 years ago
Are these results useful?