Alternatives and similar repositories for tpu_graphs

Users that are interested in tpu_graphs are comparing it to the libraries listed below

• facebookresearch / MODel_opt
  Memory Optimizations for Deep Learning (ICML 2023)
  ☆110Updated last year
• zinccat / Awesome-Triton-Kernels
  Collection of kernels written in Triton language
  ☆167Updated 7 months ago
• graphcore / tutorials
  Training material for IPU users: tutorials, feature examples, simple applications
  ☆87Updated 2 years ago
• gpu-mode / discord-cluster-manager
  Write a fast kernel and run it on Discord. See how you compare against the best!
  ☆61Updated last week
• meta-pytorch / torchsnapshot
  A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…
  ☆161Updated 2 months ago
• stanford-futuredata / stk
  ☆113Updated last year
• foundation-model-stack / foundation-model-stack
  🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.
  ☆216Updated last week
• gpu-mode / ring-attention
  ring-attention experiments
  ☆155Updated last year
• insuhan / hyper-attn
  ☆83Updated last year
• siboehm / ShallowSpeed
  Small scale distributed training of sequential deep learning models, built on Numpy and MPI.
  ☆150Updated 2 years ago
• microsoft / varuna
  ☆252Updated last year
• spcl / sten
  Sparsity support for PyTorch
  ☆37Updated 8 months ago
• Jokeren / triton-samples
  ☆28Updated 10 months ago
• gpu-mode / triton-index
  Cataloging released Triton kernels.
  ☆267Updated 2 months ago
• mengxiayu / LLMSuperWeight
  Code for studying the super weight in LLM
  ☆120Updated 11 months ago
• hpcaitech / TensorNVMe
  A Python library transfers PyTorch tensors between CPU and NVMe
  ☆121Updated 11 months ago
• epfml / dynamic-sparse-flash-attention
  ☆150Updated 2 years ago
• ml-energy / leaderboard
  A canonical source of GenAI energy benchmark and meausrements
  ☆50Updated last month
• google / aqt
  ☆337Updated 2 weeks ago
• axonn-ai / axonn
  Parallel framework for training and fine-tuning deep neural networks
  ☆68Updated 2 weeks ago
• llm-efficiency-challenge / neurips_llm_efficiency_challenge
  NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day
  ☆256Updated 2 years ago
• awslabs / slapo
  A schedule language for large model training
  ☆151Updated 3 months ago
• tanyuqian / redco
  NAACL '24 (Best Demo Paper RunnerUp) / MlSys @ NeurIPS '23 - RedCoast: A Lightweight Tool to Automate Distributed Training and Inference
  ☆68Updated 11 months ago
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆80Updated last year
• facebookresearch / dlrm_datasets
  Set of datasets for the deep learning recommendation model (DLRM).
  ☆47Updated 2 years ago
• efeslab / fiddler
  [ICLR'25] Fast Inference of MoE Models with CPU-GPU Orchestration
  ☆243Updated last year
• DS3Lab / DT-FM
  ☆93Updated 3 years ago
• CentML / DeepView.Profile
  🏙 Interactive performance profiling and debugging tool for PyTorch neural networks.
  ☆64Updated 10 months ago
• meta-pytorch / float8_experimental
  This repository contains the experimental PyTorch native float8 training UX
  ☆225Updated last year
• HazyResearch / flash-fft-conv
  FlashFFTConv: Efficient Convolutions for Long Sequences with Tensor Cores
  ☆331Updated 10 months ago