Alternatives and similar repositories for pathways-utils

Users that are interested in pathways-utils are comparing it to the libraries listed below

• AI-Hypercomputer / tpu-recipes
  ☆72Updated last week
• google / drjax
  ☆16Updated 3 months ago
• UCB-ADRS / ADRS
  AI-Driven Research Systems (ADRS)
  ☆117Updated last month
• gpu-mode / kernelbot
  Write a fast kernel and run it on Discord. See how you compare against the best!
  ☆68Updated this week
• UmerHA / triton_util
  Make triton easier
  ☆50Updated last year
• ezyang / torchdbg
  PyTorch centric eager mode debugger
  ☆48Updated last year
• AI-Hypercomputer / xpk
  xpk (Accelerated Processing Kit, pronounced x-p-k,) is a software tool to help Cloud developers to orchestrate training jobs on accelerat…
  ☆162Updated this week
• cray-lm / cray-lm
  Cray-LM unified training and inference stack.
  ☆22Updated last year
• PrimeIntellect-ai / pccl
  PCCL (Prime Collective Communications Library) implements fault tolerant collective communications over IP
  ☆141Updated 4 months ago
• RiddleHe / llm-interp
  A collection of lightweight interpretability scripts to understand how LLMs think
  ☆89Updated 2 weeks ago
• meta-pytorch / BackendBench
  Ship correct and fast LLM kernels to PyTorch
  ☆140Updated 3 weeks ago
• itsdaniele / speculative_mamba
  ☆16Updated last year
• HabanaAI / Megatron-DeepSpeed
  Intel Gaudi's Megatron DeepSpeed Large Language Models for training
  ☆18Updated last year
• AI-Hypercomputer / gpu-recipes
  Recipes for reproducing training and serving benchmarks for large machine learning models using GPUs on Google Cloud.
  ☆112Updated last week
• zhisbug / ray-scalable-ml-design
  Some microbenchmarks and design docs before commencement
  ☆12Updated 5 years ago
• open-lm-engine / lm-engine
  LM engine is a library for pretraining/finetuning LLMs
  ☆113Updated last week
• apple / ml-dataset-decomposition
  Official repo of dataset-decomposition paper [NeurIPS 2024]
  ☆20Updated last year
• lianakoleva / no-libtorch-compile
  ☆21Updated 11 months ago
• google / pathways-job
  PathwaysJob API is an OSS Kubernetes-native API, to deploy ML training and batch inference workloads, using Pathways on GKE.
  ☆17Updated 3 months ago
• Michaelvll / llm-ie-benchmarks
  A collection of reproducible inference engine benchmarks
  ☆38Updated 9 months ago
• foundation-model-stack / fms-acceleration
  🚀 Collection of libraries used with fms-hf-tuning to accelerate fine-tuning and training of large models.
  ☆13Updated last week
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆82Updated 2 years ago
• eth-easl / mixtera
  A lightweight, user-friendly data-plane for LLM training.
  ☆38Updated 4 months ago
• tyler-romero / microR1
  Simple repository for training small reasoning models
  ☆48Updated last year
• fattorib / ZeRO-transformer
  Two implementations of ZeRO-1 optimizer sharding in JAX
  ☆14Updated 2 years ago
• axonn-ai / axonn
  Parallel framework for training and fine-tuning deep neural networks
  ☆70Updated 2 months ago
• abacusai / gh200-llm
  Docker image NVIDIA GH200 machines - optimized for vllm serving and hf trainer finetuning
  ☆53Updated 11 months ago
• google-deepmind / asyncdiloco
  ☆47Updated 2 years ago
• stas00 / ml-ways
  ML/DL Math and Method notes
  ☆66Updated 2 years ago
• yixiaoer / mistral-v0.2-jax
  JAX implementation of the Mistral 7b v0.2 model
  ☆35Updated last year