siboehm / ShallowSpeedLinks
Small scale distributed training of sequential deep learning models, built on Numpy and MPI.
☆134Updated last year
Alternatives and similar repositories for ShallowSpeed
Users that are interested in ShallowSpeed are comparing it to the libraries listed below
Sorting:
- ☆219Updated this week
- Cataloging released Triton kernels.☆236Updated 5 months ago
- extensible collectives library in triton☆86Updated 2 months ago
- Applied AI experiments and examples for PyTorch☆277Updated 3 weeks ago
- ring-attention experiments☆144Updated 8 months ago
- Write a fast kernel and run it on Discord. See how you compare against the best!☆46Updated this week
- A curated collection of resources, tutorials, and best practices for learning and mastering NVIDIA CUTLASS☆186Updated last month
- Fast low-bit matmul kernels in Triton☆322Updated this week
- ☆159Updated last year
- Learn CUDA with PyTorch☆25Updated 2 weeks ago
- Collection of kernels written in Triton language☆128Updated 2 months ago
- seqax = sequence modeling + JAX☆159Updated last week
- Experiment of using Tangent to autodiff triton☆79Updated last year
- PTX-Tutorial Written Purely By AIs (Deep Research of Openai and Claude 3.7)☆67Updated 2 months ago
- Fastest kernels written from scratch☆281Updated 2 months ago
- ☆88Updated last year
- An implementation of the transformer architecture onto an Nvidia CUDA kernel☆185Updated last year
- ☆109Updated 3 months ago
- A repository to unravel the language of GPUs, making their kernel conversations easy to understand☆184Updated 3 weeks ago
- High-Performance SGEMM on CUDA devices☆95Updated 5 months ago
- This repository contains the experimental PyTorch native float8 training UX☆224Updated 10 months ago
- A bunch of kernels that might make stuff slower 😉☆51Updated this week
- Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.☆136Updated this week
- KernelBench: Can LLMs Write GPU Kernels? - Benchmark with Torch -> CUDA problems☆415Updated 3 weeks ago
- Reference Kernels for the Leaderboard☆59Updated this week
- The simplest but fast implementation of matrix multiplication in CUDA.☆35Updated 10 months ago
- A Python-embedded DSL that makes it easy to write fast, scalable ML kernels with minimal boilerplate.☆166Updated this week
- ☆168Updated last year
- ☆72Updated last year
- Custom kernels in Triton language for accelerating LLMs☆22Updated last year