Alternatives and similar repositories for pytorch-mps-noncontiguous-bug

Users that are interested in pytorch-mps-noncontiguous-bug are comparing it to the libraries listed below

• meta-pytorch / torchft
  Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)
  ☆462Updated this week
• rwitten / HighPerfLLMs2024
  ☆548Updated last year
• apple / ml-recurrent-drafter
  ☆219Updated 11 months ago
• AI-Hypercomputer / maxdiffusion
  ☆291Updated this week
• siboehm / ShallowSpeed
  Small scale distributed training of sequential deep learning models, built on Numpy and MPI.
  ☆153Updated 2 years ago
• google-deepmind / nanodo
  ☆287Updated last year
• modula-systems / modula
  🧱 Modula software package
  ☆316Updated 4 months ago
• imbue-ai / cluster-health
  ☆318Updated last year
• facebookresearch / optimizers
  For optimization algorithm research and development.
  ☆555Updated last week
• huggingface / gpu-fryer
  Where GPUs get cooked 👩‍🍳🔥
  ☆343Updated 3 months ago
• run-ai / runai-model-streamer
  ☆273Updated last week
• Aleph-Alpha / Alpha-MoE
  ☆43Updated 3 weeks ago
• facebookresearch / spdl
  Scalable and Performant Data Loading
  ☆356Updated last week
• meta-pytorch / monarch
  PyTorch Single Controller
  ☆932Updated last week
• facebookresearch / HolisticTraceAnalysis
  A library to analyze PyTorch traces.
  ☆452Updated 2 weeks ago
• xjdr-alt / simple_transformer
  Simple Transformer in Jax
  ☆141Updated last year
• microsoft / dion
  Dion optimizer algorithm
  ☆411Updated last week
• Noumena-Network / nmoe
  MoE training for Me and You and maybe other people
  ☆298Updated 2 weeks ago
• AI-Hypercomputer / JetStream
  JetStream is a throughput and memory optimized engine for LLM inference on XLA devices, starting with TPUs (and GPUs in future -- PRs wel…
  ☆397Updated 6 months ago
• dshah3 / GPU-Puzzles
  Solve puzzles. Learn CUDA.
  ☆64Updated 2 years ago
• KellerJordan / cifar10-airbench
  CIFAR-10 speedruns: 94% in 2.6 seconds and 96% in 27 seconds
  ☆336Updated last month
• srush / Transformer-Puzzles
  Puzzles for exploring transformers
  ☆380Updated 2 years ago
• MatX-inc / seqax
  seqax = sequence modeling + JAX
  ☆169Updated 5 months ago
• Quentin-Anthony / torch-profiling-tutorial
  ☆536Updated 4 months ago
• pyember / ember
  ☆234Updated 6 months ago
• gpu-mode / ring-attention
  ring-attention experiments
  ☆160Updated last year
• nebius / kvax
  A FlashAttention implementation for JAX with support for efficient document mask computation and context parallelism.
  ☆153Updated last month
• gpu-mode / profiling-cuda-in-torch
  ☆178Updated last year
• pytorch / helion
  A Python-embedded DSL that makes it easy to write fast, scalable ML kernels with minimal boilerplate.
  ☆697Updated this week
• jax-ml / scaling-book
  Home for "How To Scale Your Model", a short blog-style textbook about scaling LLMs on TPUs
  ☆791Updated this week