Small scale distributed training of sequential deep learning models, built on Numpy and MPI.
☆170Oct 19, 2023Updated 3 years ago
Alternatives and similar repositories for ShallowSpeed
Users that are interested in ShallowSpeed are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Resources for RadixMLP☆14Jan 18, 2026Updated 9 months ago
- Fast CUDA matrix multiplication from scratch☆1,349Sep 2, 2025Updated last year
- ☆95Jul 5, 2024Updated 2 years ago
- Step-by-step optimization of CUDA SGEMM☆523Mar 30, 2022Updated 4 years ago
- 🔀 yet another mixture of experts☆24Jun 5, 2026Updated 4 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Minimal but scalable implementation of large language models in JAX☆34Nov 28, 2025Updated 11 months ago
- What would you do with 1000 H100s...☆1,202Jan 10, 2024Updated 2 years ago
- Fastest kernels written from scratch☆629Aug 15, 2026Updated 2 months ago
- GPU programming related news and material links☆2,404Jun 15, 2026Updated 4 months ago
- ☆30Dec 2, 2024Updated last year
- Minimalistic 4D-parallelism distributed training framework for education purpose☆2,336Aug 26, 2025Updated last year
- Cataloging released Triton kernels.☆314Sep 9, 2025Updated last year
- A Quirky Assortment of CuTe Kernels☆1,188Updated this week
- ☆594Jul 11, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆16May 24, 2026Updated 5 months ago
- [ICLR 2026] Official Implementation of the paper: "Two are better than one: Context window extension with multi-grained self-injection"☆12Feb 1, 2026Updated 9 months ago
- ☆101May 30, 2026Updated 5 months ago
- Odysseus: Playground of LLM Sequence Parallelism☆83Jun 17, 2024Updated 2 years ago
- ring-attention experiments☆176Oct 17, 2024Updated 2 years ago
- Tile primitives for speedy kernels☆3,788Sep 12, 2026Updated last month
- a whirlwind tour to deep learning alchemy and deep learning systems☆95Updated this week
- ☆307Jul 15, 2024Updated 2 years ago
- ☆171Dec 27, 2024Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆51Jan 18, 2024Updated 2 years ago
- Puzzles for learning Triton☆2,655Apr 1, 2026Updated 7 months ago
- UNet diffusion model in pure CUDA☆669Jun 28, 2024Updated 2 years ago
- Nsight Python is a Python kernel profiling interface based on NVIDIA Nsight Tools☆301Updated this week
- Benchmark scripts for comparing tutorials in PyTorch and JAX☆14Aug 25, 2022Updated 4 years ago
- A library to analyze PyTorch traces.☆564Updated this week
- A PyTorch native platform for training generative AI models☆5,868Updated this week
- An ML Systems Onboarding list☆1,149Feb 19, 2026Updated 8 months ago
- The best ChatGPT that $100 can buy.☆60Updated this week
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Official Problem Sets / Reference Kernels for the GPU MODE Leaderboard!☆321Sep 18, 2026Updated last month
- Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)☆551Updated this week
- A repository to unravel the language of GPUs, making their kernel conversations easy to understand☆219Jun 1, 2025Updated last year
- MoE training for Me and You and maybe other people☆400Mar 15, 2026Updated 7 months ago
- ☆92Feb 29, 2024Updated 2 years ago
- A pure-Python implementation of the Nvidia CuTe layout algebra intended to be approachable and easy to learn.☆256Jun 29, 2026Updated 4 months ago
- The code for the video tutorial series on building a Transformer from scratch: https://www.youtube.com/watch?v=XR4VDnJzB8o☆19Apr 15, 2023Updated 3 years ago