Alternatives and similar repositories for gpu-fryer:

Users that are interested in gpu-fryer are comparing it to the libraries listed below

• pytorch / torchft
  PyTorch per step fault tolerance (actively under development)
  ☆271Updated this week
• MekkCyber / TritonAcademy
  A repository to unravel the language of GPUs, making their kernel conversations easy to understand
  ☆169Updated last week
• vdesai2014 / inference-optimization-blog-post
  ☆87Updated last year
• gpu-mode / profiling-cuda-in-torch
  ☆152Updated last year
• facebookresearch / spdl
  Scalable and Performant Data Loading
  ☆231Updated this week
• foundation-model-stack / fms-fsdp
  🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…
  ☆234Updated this week
• MekkCyber / CutlassAcademy
  A curated collection of resources, tutorials, and best practices for learning and mastering NVIDIA CUTLASS
  ☆154Updated last week
• apple / ml-recurrent-drafter
  ☆204Updated 2 months ago
• huggingface / picotron_tutorial
  ☆158Updated last month
• salykova / sgemm.cu
  High-Performance SGEMM on CUDA devices
  ☆88Updated 2 months ago
• huggingface / inference-benchmarker
  Inference server benchmarking tool
  ☆38Updated this week
• unixpickle / learn-ptx
  Learning about CUDA by writing PTX code.
  ☆125Updated last year
• huggingface / kernels
  Load compute kernels from the Hub
  ☆107Updated this week
• rkinas / triton-resources
  A curated list of resources for learning and exploring Triton, OpenAI's programming language for writing efficient GPU code.
  ☆318Updated 3 weeks ago
• LambdaLabsML / distributed-training-guide
  Best practices & guides on how to write distributed pytorch training code
  ☆383Updated last month
• neuralmagic / nm-vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆262Updated 5 months ago
• mobiusml / gemlite
  Fast low-bit matmul kernels in Triton
  ☆275Updated this week
• pytorch-labs / applied-ai
  Applied AI experiments and examples for PyTorch
  ☆251Updated last week
• NVIDIA / NeMo-Run
  A tool to configure, launch and manage your machine learning experiments.
  ☆133Updated this week
• pytorch-labs / float8_experimental
  This repository contains the experimental PyTorch native float8 training UX
  ☆222Updated 8 months ago
• huggingface / optimum-tpu
  Google TPU optimizations for transformers models
  ☆104Updated 2 months ago
• gpu-mode / discord-cluster-manager
  Write a fast kernel and run it on Discord. See how you compare against the best!
  ☆35Updated this week
• NVIDIA / kvpress
  LLM KV cache compression made easy
  ☆444Updated 2 weeks ago
• Deep-Learning-Profiling-Tools / triton-viz
  ☆192Updated this week
• cray-lm / cray-lm
  Cray-LM unified training and inference stack.
  ☆21Updated 2 months ago
• cloneofsimo / ptx-tutorial-by-aislop
  PTX-Tutorial Written Purely By AIs (Deep Research of Openai and Claude 3.7)
  ☆62Updated last week
• SzymonOzog / GPU_Programming
  ☆47Updated this week
• mixedbread-ai / batched
  The Batched API provides a flexible and efficient way to process multiple requests in a batch, with a primary focus on dynamic batching o…
  ☆127Updated 3 months ago
• BobMcDear / attorch
  A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.
  ☆524Updated last month
• mlops-discord / gpu-optimization-workshop
  Slides, notes, and materials for the workshop
  ☆321Updated 10 months ago