Alternatives and similar repositories for monarch

Users that are interested in monarch are comparing it to the libraries listed below

• lianakoleva / no-libtorch-compile
  ☆21Updated 3 months ago
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆79Updated last year
• cchan / tccl
  extensible collectives library in triton
  ☆87Updated 2 months ago
• HazyResearch / train-tk
  train with kittens!
  ☆57Updated 7 months ago
• gpu-mode / discord-cluster-manager
  Write a fast kernel and run it on Discord. See how you compare against the best!
  ☆44Updated this week
• Jokeren / triton-samples
  ☆28Updated 4 months ago
• ezyang / torchdbg
  PyTorch centric eager mode debugger
  ☆47Updated 5 months ago
• drisspg / transformer_nuggets
  A place to store reusable transformer components of my own creation or found on the interwebs
  ☆56Updated 3 weeks ago
• siboehm / ShallowSpeed
  Small scale distributed training of sequential deep learning models, built on Numpy and MPI.
  ☆133Updated last year
• cisco-open / pymultiworld
  A framework for PyTorch to enable fault management for collective communication libraries (CCL) such as NCCL
  ☆19Updated last month
• NVIDIA / jaxpp
  JaxPP is a library for JAX that enables flexible MPMD pipeline parallelism for large-scale LLM training
  ☆45Updated 2 weeks ago
• UmerHA / triton_util
  Make triton easier
  ☆47Updated 11 months ago
• nunoplopes / torchy
  A tracing JIT compiler for PyTorch
  ☆13Updated 3 years ago
• pytorch / tlparse
  TORCH_LOGS parser for PT2
  ☆38Updated last week
• jax-ml / ml_dtypes
  A stand-alone implementation of several NumPy dtype extensions used in machine learning.
  ☆268Updated last week
• AI-Hypercomputer / cloud-accelerator-diagnostics
  ☆20Updated 2 weeks ago
• lessw2020 / triton_kernels_for_fun_and_profit
  Custom kernels in Triton language for accelerating LLMs
  ☆20Updated last year
• srush / anynp
  Proof-of-concept of global switching between numpy/jax/pytorch in a library.
  ☆18Updated 11 months ago
• gau-nernst / learn-cuda
  Learn CUDA with PyTorch
  ☆21Updated this week
• PrimeIntellect-ai / pccl
  PCCL (Prime Collective Communications Library) implements fault tolerant collective communications over IP
  ☆88Updated 2 weeks ago
• graphcore-research / out-of-the-box-fp8-training
  Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.
  ☆44Updated 10 months ago
• iree-org / iree-jax
  ☆52Updated 9 months ago
• AllanYangZhou / midGPT
  Distributed pretraining of large language models (LLMs) on cloud TPU slices, with Jax and Equinox.
  ☆24Updated 8 months ago
• ppl-ai / libfabric-efa-demo
  ☆62Updated 3 months ago
• openxla / shardy
  MLIR-based partitioning system
  ☆86Updated this week
• MatX-inc / seqax
  seqax = sequence modeling + JAX
  ☆155Updated last month
• sholtodouglas / scalingExperiments
  ☆59Updated 3 years ago
• jax-ml / jax-tpu-embedding
  ☆18Updated this week
• mikex86 / tritonc
  Standalone commandline CLI tool for compiling Triton kernels
  ☆18Updated 8 months ago
• AI-Hypercomputer / jetstream-pytorch
  PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"
  ☆60Updated 2 months ago