Alternatives and similar repositories for tpu_graphs

Users that are interested in tpu_graphs are comparing it to the libraries listed below

• facebookresearch / MODel_opt
  Memory Optimizations for Deep Learning (ICML 2023)
  ☆64Updated last year
• zinccat / Awesome-Triton-Kernels
  Collection of kernels written in Triton language
  ☆122Updated last month
• shawntan / scattermoe
  Triton-based implementation of Sparse Mixture of Experts.
  ☆214Updated 5 months ago
• foundation-model-stack / foundation-model-stack
  🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.
  ☆195Updated this week
• insuhan / hyper-attn
  ☆81Updated last year
• kaidic / GST
  ☆23Updated last year
• siboehm / ShallowSpeed
  Small scale distributed training of sequential deep learning models, built on Numpy and MPI.
  ☆132Updated last year
• stanford-futuredata / stk
  ☆104Updated 8 months ago
• gpu-mode / triton-index
  Cataloging released Triton kernels.
  ☆221Updated 4 months ago
• llm-efficiency-challenge / neurips_llm_efficiency_challenge
  NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day
  ☆255Updated last year
• mengxiayu / LLMSuperWeight
  Code for studying the super weight in LLM
  ☆100Updated 5 months ago
• dlsyscourse / hw0
  ☆32Updated last year
• epfml / dynamic-sparse-flash-attention
  ☆146Updated last year
• BobMcDear / attorch
  A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.
  ☆536Updated this week
• google / aqt
  ☆301Updated last week
• cchan / tccl
  extensible collectives library in triton
  ☆86Updated last month
• MDK8888 / vllmini
  A minimal implementation of vllm.
  ☆40Updated 9 months ago
• fkodom / python-repo-template
  Template repo for Python projects, especially those focusing on machine learning and/or deep learning.
  ☆15Updated 3 weeks ago
• HazyResearch / flash-fft-conv
  FlashFFTConv: Efficient Convolutions for Long Sequences with Tensor Cores
  ☆317Updated 4 months ago
• rapidsai / wholegraph
  WholeGraph - large scale Graph Neural Networks
  ☆105Updated 5 months ago
• srush / annotated-mamba
  Annotated version of the Mamba paper
  ☆483Updated last year
• microsoft / varuna
  ☆250Updated 9 months ago
• pytorch / torchsnapshot
  A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…
  ☆157Updated 5 months ago
• awslabs / slapo
  A schedule language for large model training
  ☆147Updated 10 months ago
• gpu-mode / ring-attention
  ring-attention experiments
  ☆142Updated 6 months ago
• lucidrains / speculative-decoding
  Explorations into some recent techniques surrounding speculative decoding
  ☆264Updated 4 months ago
• hpcaitech / TensorNVMe
  A Python library transfers PyTorch tensors between CPU and NVMe
  ☆115Updated 5 months ago
• mlcommons / algorithmic-efficiency
  MLCommons Algorithmic Efficiency is a benchmark and competition measuring neural network training speedups due to algorithmic improvement…
  ☆382Updated last week
• AlibabaResearch / flash-llm
  Flash-LLM: Enabling Cost-Effective and Highly-Efficient Large Generative Model Inference with Unstructured Sparsity
  ☆206Updated last year
• PiotrNawrot / nano-sparse-attention
  The simplest implementation of recent Sparse Attention patterns for efficient LLM inference.
  ☆60Updated 3 months ago