Alternatives and similar repositories for minPP

Users that are interested in minPP are comparing it to the libraries listed below

• WaveSpeedAI / QuantumAttention
  [WIP] Better (FP8) attention for Hopper
  ☆32Updated 6 months ago
• gpu-mode / ring-attention
  ring-attention experiments
  ☆150Updated 10 months ago
• gpu-mode / profiling-cuda-in-torch
  ☆163Updated last year
• huggingface / kernel-builder
  👷 Build compute kernels
  ☆119Updated last week
• Michaelvll / llm-ie-benchmarks
  A collection of reproducible inference engine benchmarks
  ☆32Updated 4 months ago
• vdesai2014 / inference-optimization-blog-post
  ☆88Updated last year
• graphcore-research / out-of-the-box-fp8-training
  Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.
  ☆46Updated last year
• cchan / tccl
  extensible collectives library in triton
  ☆88Updated 5 months ago
• microsoft / AttentionEngine
  ☆92Updated 3 months ago
• huggingface / kernels
  Load compute kernels from the Hub
  ☆258Updated last week
• gpu-mode / discord-cluster-manager
  Write a fast kernel and run it on Discord. See how you compare against the best!
  ☆51Updated last week
• UmerHA / triton_util
  Make triton easier
  ☆47Updated last year
• deepreinforce-ai / CUDA-L1
  CUDA-L1: Improving CUDA Optimization via Contrastive Reinforcement Learning
  ☆182Updated 3 weeks ago
• deepspeedai / DeepSpeed-Kernels
  ☆74Updated 5 months ago
• MekkCyber / CutlassAcademy
  A curated collection of resources, tutorials, and best practices for learning and mastering NVIDIA CUTLASS
  ☆214Updated 3 months ago
• Deep-Learning-Profiling-Tools / triton-viz
  ☆234Updated 2 weeks ago
• open-lm-engine / flash-model-architectures
  A bunch of kernels that might make stuff slower 😉
  ☆58Updated 2 weeks ago
• pytorch / torchft
  Fault tolerance for PyTorch (HSDP, LocalSGD, DiLoCo, Streaming DiLoCo)
  ☆392Updated this week
• NVIDIA / jaxpp
  JaxPP is a library for JAX that enables flexible MPMD pipeline parallelism for large-scale LLM training
  ☆52Updated 3 weeks ago
• cloneofsimo / ptx-tutorial-by-aislop
  PTX-Tutorial Written Purely By AIs (Deep Research of Openai and Claude 3.7)
  ☆66Updated 5 months ago
• GindaChen / FlexFlashAttention3
  FlexAttention w/ FlashAttention3 Support
  ☆27Updated 11 months ago
• meta-pytorch / float8_experimental
  This repository contains the experimental PyTorch native float8 training UX
  ☆224Updated last year
• mobiusml / gemlite
  Fast low-bit matmul kernels in Triton
  ☆356Updated last week
• meta-pytorch / superblock
  A block oriented training approach for inference time optimization.
  ☆34Updated last year
• MekkCyber / TritonAcademy
  A repository to unravel the language of GPUs, making their kernel conversations easy to understand
  ☆191Updated 3 months ago
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆80Updated last year
• pytorch / torchsnapshot
  A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…
  ☆159Updated 2 months ago
• meta-pytorch / applied-ai
  Applied AI experiments and examples for PyTorch
  ☆292Updated last week
• IST-DASLab / Quartet
  ☆85Updated last week
• KONAKONA666 / q8_kernels
  ☆75Updated 8 months ago