Alternatives and similar repositories for rockmate

Users that are interested in rockmate are comparing it to the libraries listed below

• facebookresearch / MODel_opt
  Memory Optimizations for Deep Learning (ICML 2023)
  ☆64Updated last year
• pytorch-labs / tritonbench
  Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.
  ☆124Updated this week
• BradMcDanel / sdgp
  ☆10Updated 3 years ago
• graphcore-research / unit-scaling
  A library for unit scaling in PyTorch
  ☆125Updated 5 months ago
• stanford-futuredata / stk
  ☆104Updated 8 months ago
• spcl / sten
  Sparsity support for PyTorch
  ☆34Updated last month
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆78Updated last year
• cchan / tccl
  extensible collectives library in triton
  ☆86Updated last month
• graphcore-research / out-of-the-box-fp8-training
  Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.
  ☆45Updated 10 months ago
• Jokeren / triton-samples
  ☆27Updated 4 months ago
• albanD / subclass_zoo
  ☆167Updated 11 months ago
• thu-ml / Jetfire-INT8Training
  ☆47Updated 9 months ago
• zinccat / Awesome-Triton-Kernels
  Collection of kernels written in Triton language
  ☆122Updated last month
• ScalingIntelligence / CATS
  ☆24Updated 6 months ago
• INT-FlashAttention2024 / INT-FlashAttention
  ☆70Updated 3 months ago
• Dao-AILab / fast-hadamard-transform
  Fast Hadamard transform in CUDA, with a PyTorch interface
  ☆187Updated 11 months ago
• Distributed-AI / PipeTransformer
  PipeTransformer: Automated Elastic Pipelining for Distributed Training of Large-scale Models. ICML 2021
  ☆56Updated 3 years ago
• ptillet / torch-blocksparse
  Block-sparse primitives for PyTorch
  ☆155Updated 4 years ago
• yaozhewei / HAP
  ☆43Updated last year
• jundaf2 / INT8-Flash-Attention-FMHA-Quantization
  ☆158Updated last year
• Youhe-Jiang / IJCAI2023-OptimalShardedDataParallel
  [IJCAI2023] An automated parallel training system that combines the advantages from both data and model parallelism. If you have any inte…
  ☆51Updated last year
• gpauloski / kfac-pytorch
  Distributed K-FAC preconditioner for PyTorch
  ☆86Updated this week
• tgale96 / grouped_gemm
  PyTorch bindings for CUTLASS grouped GEMM.
  ☆89Updated 2 weeks ago
• pytorch-labs / helion
  A Python-embedded DSL that makes it easy to write fast, scalable ML kernels with minimal boilerplate.
  ☆138Updated this week
• naver-aics / lut-gemm
  ☆55Updated last year
• pytorch-labs / float8_experimental
  This repository contains the experimental PyTorch native float8 training UX
  ☆222Updated 9 months ago
• jianweif / OptimalGradCheckpointing
  ☆40Updated 3 years ago
• DachengLi1 / AMP
  (NeurIPS 2022) Automatically finding good model-parallel strategies, especially for complex models and clusters.
  ☆38Updated 2 years ago
• microsoft / TileFusion
  TileFusion is an experimental C++ macro kernel template library that elevates the abstraction level in CUDA C for tile processing.
  ☆85Updated this week
• mayank31398 / cute-kernels
  A bunch of kernels that might make stuff slower 😉
  ☆40Updated this week