Alternatives and similar repositories for aqt

Users that are interested in aqt are comparing it to the libraries listed below

• meta-pytorch / float8_experimental
  This repository contains the experimental PyTorch native float8 training UX
  ☆227Updated last year
• google / praxis
  ☆191Updated 3 weeks ago
• jax-ml / jax-triton
  jax-triton contains integrations between JAX and OpenAI Triton
  ☆436Updated last month
• google / paxml
  Pax is a Jax-based machine learning framework for training large scale models. Pax allows for advanced and fully configurable experimenta…
  ☆542Updated 3 weeks ago
• dropbox / gemlite
  Fast low-bit matmul kernels in Triton
  ☆418Updated 3 weeks ago
• graphcore-research / unit-scaling
  A library for unit scaling in PyTorch
  ☆133Updated 6 months ago
• BobMcDear / attorch
  A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.
  ☆592Updated 5 months ago
• Deep-Learning-Profiling-Tools / triton-viz
  ☆270Updated last week
• MatX-inc / seqax
  seqax = sequence modeling + JAX
  ☆169Updated 5 months ago
• pytorch / helion
  A Python-embedded DSL that makes it easy to write fast, scalable ML kernels with minimal boilerplate.
  ☆706Updated this week
• foundation-model-stack / foundation-model-stack
  🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.
  ☆218Updated this week
• meta-pytorch / applied-ai
  Applied AI experiments and examples for PyTorch
  ☆312Updated 4 months ago
• shawntan / scattermoe
  Triton-based implementation of Sparse Mixture of Experts.
  ☆259Updated 3 months ago
• jax-ml / ml_dtypes
  A stand-alone implementation of several NumPy dtype extensions used in machine learning.
  ☆323Updated last week
• cchan / tccl
  extensible collectives library in triton
  ☆91Updated 9 months ago
• albanD / subclass_zoo
  ☆187Updated last year
• lucidrains / triton-transformer
  Implementation of a Transformer, but completely in Triton
  ☆278Updated 3 years ago
• lucidrains / flash-attention-jax
  Implementation of Flash Attention in Jax
  ☆223Updated last year
• proger / accelerated-scan
  Accelerated First Order Parallel Associative Scan
  ☆192Updated this week
• google / saxml
  ☆149Updated this week
• foundation-model-stack / fms-fsdp
  🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…
  ☆278Updated last month
• openxla / tokamax
  Tokamax: A GPU and TPU kernel library.
  ☆158Updated this week
• siboehm / ShallowSpeed
  Small scale distributed training of sequential deep learning models, built on Numpy and MPI.
  ☆154Updated 2 years ago
• NVIDIA / JAX-Toolbox
  JAX-Toolbox
  ☆373Updated this week
• zinccat / Awesome-Triton-Kernels
  Collection of kernels written in Triton language
  ☆174Updated 9 months ago
• facebookresearch / HolisticTraceAnalysis
  A library to analyze PyTorch traces.
  ☆454Updated 3 weeks ago
• marin-community / levanter
  Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax
  ☆688Updated 2 weeks ago
• Dao-AILab / quack
  A Quirky Assortment of CuTe Kernels
  ☆741Updated this week
• nshepperd / flash_attn_jax
  JAX bindings for Flash Attention v2
  ☆102Updated 2 weeks ago
• NVIDIA / jaxpp
  JaxPP is a library for JAX that enables flexible MPMD pipeline parallelism for large-scale LLM training
  ☆62Updated this week