Alternatives and similar repositories for sten:

Users that are interested in sten are comparing it to the libraries listed below

• facebookresearch / MODel_opt
  Memory Optimizations for Deep Learning (ICML 2023)
  ☆62Updated 10 months ago
• cchan / tccl
  extensible collectives library in triton
  ☆77Updated 4 months ago
• Dao-AILab / fast-hadamard-transform
  Fast Hadamard transform in CUDA, with a PyTorch interface
  ☆135Updated 8 months ago
• triton-lang / kernels
  ☆64Updated 2 months ago
• exists-forall / striped_attention
  ☆38Updated last year
• microsoft / TileFusion
  TileFusion is a highly efficient kernel template library designed to elevate the level of abstraction in CUDA C for processing tiles.
  ☆43Updated this week
• stanford-futuredata / stk
  ☆97Updated 5 months ago
• tgale96 / grouped_gemm
  PyTorch bindings for CUTLASS grouped GEMM.
  ☆61Updated 2 months ago
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆74Updated last year
• spcl / substation
  Research and development for optimizing transformers
  ☆125Updated 3 years ago
• topal-team / rockmate
  ☆35Updated last month
• DachengLi1 / AMP
  (NeurIPS 2022) Automatically finding good model-parallel strategies, especially for complex models and clusters.
  ☆37Updated 2 years ago
• graphcore-research / out-of-the-box-fp8-training
  Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.
  ☆43Updated 6 months ago
• pytorch-labs / tritonbench
  Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.
  ☆86Updated this week
• uwsampl / SparseTIR
  SparseTIR: Sparse Tensor Compiler for Deep Learning
  ☆133Updated last year
• axonn-ai / axonn
  A parallel framework for training deep neural networks
  ☆50Updated last week
• xiayuqing0622 / flex_head_fa
  Fast and memory-efficient exact attention
  ☆57Updated last month
• gpauloski / kfac-pytorch
  Distributed K-FAC Preconditioner for PyTorch
  ☆85Updated this week
• DerrickYLJ / TidalDecode
  [ICLR 2025] TidalDecode: A Fast and Accurate LLM Decoding with Position Persistent Sparse Attention
  ☆26Updated last month
• thu-ml / Jetfire-INT8Training
  ☆31Updated 6 months ago
• olcf / NVIDIA-tensor-core-examples
  ☆16Updated 5 years ago
• spcl / daceml
  A Data-Centric Compiler for Machine Learning
  ☆82Updated last year
• awslabs / ratex
  ☆23Updated 2 months ago
• shawntan / scattermoe
  Triton-based implementation of Sparse Mixture of Experts.
  ☆194Updated 2 months ago
• brightlaboratory / polydl
  ☆12Updated 3 years ago
• Jokeren / triton-samples
  ☆24Updated 2 weeks ago
• hpcaitech / TensorNVMe
  A Python library transfers PyTorch tensors between CPU and NVMe
  ☆102Updated 2 months ago
• Youhe-Jiang / IJCAI2023-OptimalShardedDataParallel
  [IJCAI2023] An automated parallel training system that combines the advantages from both data and model parallelism. If you have any inte…
  ☆51Updated last year
• hwang595 / Cuttlefish
  The implementation for MLSys 2023 paper: "Cuttlefish: Low-rank Model Training without All The Tuning"
  ☆43Updated last year
• graphcore-research / unit-scaling
  A library for unit scaling in PyTorch
  ☆122Updated 2 months ago