Alternatives and similar repositories for pathways-utils

Users that are interested in pathways-utils are comparing it to the libraries listed below

• AI-Hypercomputer / tpu-recipes
  ☆54Updated this week
• jax-ml / jax-tpu-embedding
  ☆25Updated last week
• google / torchax
  torchax is a PyTorch frontend for JAX. It gives JAX the ability to author JAX programs using familiar PyTorch syntax. It also provides JA…
  ☆128Updated last week
• AI-Hypercomputer / xpk
  xpk (Accelerated Processing Kit, pronounced x-p-k,) is a software tool to help Cloud developers to orchestrate training jobs on accelerat…
  ☆153Updated this week
• itsdaniele / speculative_mamba
  ☆15Updated last year
• gpu-mode / discord-cluster-manager
  Write a fast kernel and run it on Discord. See how you compare against the best!
  ☆61Updated this week
• GoogleCloudPlatform / slurm-gcp
  ☆57Updated this week
• HabanaAI / Megatron-DeepSpeed
  Intel Gaudi's Megatron DeepSpeed Large Language Models for training
  ☆15Updated 11 months ago
• google / drjax
  ☆15Updated last month
• google / pathways-job
  PathwaysJob API is an OSS Kubernetes-native API, to deploy ML training and batch inference workloads, using Pathways on GKE.
  ☆15Updated last month
• lianakoleva / no-libtorch-compile
  ☆21Updated 8 months ago
• ezyang / torchdbg
  PyTorch centric eager mode debugger
  ☆48Updated 11 months ago
• axonn-ai / axonn
  Parallel framework for training and fine-tuning deep neural networks
  ☆69Updated 2 weeks ago
• apple / ml-dataset-decomposition
  Official repo of dataset-decomposition paper [NeurIPS 2024]
  ☆20Updated 10 months ago
• yixiaoer / tpu-training-example
  ☆16Updated last year
• Michaelvll / llm-ie-benchmarks
  A collection of reproducible inference engine benchmarks
  ☆37Updated 7 months ago
• NVIDIA-NeMo / Automodel
  Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support
  ☆187Updated this week
• ryantd / veloce
  WIP. Veloce is a low-code Ray-based parallelization library that makes machine learning computation novel, efficient, and heterogeneous.
  ☆17Updated 3 years ago
• foundation-model-stack / fms-acceleration
  🚀 Collection of libraries used with fms-hf-tuning to accelerate fine-tuning and training of large models.
  ☆13Updated this week
• HuyNguyen-hust / hopper-gemm-101
  ☆11Updated 11 months ago
• yixiaoer / tpux
  A set of Python scripts that makes your experience on TPU better
  ☆54Updated 2 months ago
• AI-Hypercomputer / jetstream-pytorch
  PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"
  ☆78Updated 2 months ago
• zhisbug / ray-scalable-ml-design
  Some microbenchmarks and design docs before commencement
  ☆12Updated 4 years ago
• huggingface / kernel-builder
  👷 Build compute kernels
  ☆186Updated this week
• tyler-romero / microR1
  Simple repository for training small reasoning models
  ☆46Updated 9 months ago
• HazyResearch / train-tk
  train with kittens!
  ☆63Updated last year
• fattorib / ZeRO-transformer
  Two implementations of ZeRO-1 optimizer sharding in JAX
  ☆14Updated 2 years ago
• evanatyourservice / llm-jax
  Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.
  ☆18Updated 4 months ago
• google / saxml
  ☆147Updated 3 weeks ago
• meta-pytorch / BackendBench
  How to ensure correctness and ship LLM generated kernels in PyTorch
  ☆121Updated 2 weeks ago