Alternatives and similar repositories for Penny

Users that are interested in Penny are comparing it to the libraries listed below

• IST-DASLab / llmq
  Quantized LLM training in pure CUDA/C++.
  ☆215Updated this week
• gpu-mode / discord-cluster-manager
  Write a fast kernel and run it on Discord. See how you compare against the best!
  ☆61Updated this week
• unixpickle / learn-ptx
  Learning about CUDA by writing PTX code.
  ☆147Updated last year
• gpu-mode / reference-kernels
  Official Problem Sets / Reference Kernels for the GPU MODE Leaderboard!
  ☆140Updated this week
• cloneofsimo / ptx-tutorial-by-aislop
  PTX-Tutorial Written Purely By AIs (Deep Research of Openai and Claude 3.7)
  ☆66Updated 7 months ago
• axonn-ai / axonn
  Parallel framework for training and fine-tuning deep neural networks
  ☆67Updated 3 weeks ago
• HazyResearch / train-tk
  train with kittens!
  ☆63Updated last year
• meta-pytorch / BackendBench
  How to ensure correctness and ship LLM generated kernels in PyTorch
  ☆114Updated last week
• siboehm / ShallowSpeed
  Small scale distributed training of sequential deep learning models, built on Numpy and MPI.
  ☆148Updated 2 years ago
• salykova / sgemm.cu
  High-Performance SGEMM on CUDA devices
  ☆109Updated 9 months ago
• PrimeIntellect-ai / pccl
  PCCL (Prime Collective Communications Library) implements fault tolerant collective communications over IP
  ☆138Updated 2 months ago
• gpu-mode / popcorn-cli
  ☆63Updated this week
• microsoft / dion
  Dion optimizer algorithm
  ☆383Updated this week
• NVIDIA / jaxpp
  JaxPP is a library for JAX that enables flexible MPMD pipeline parallelism for large-scale LLM training
  ☆55Updated 3 weeks ago
• cchan / tccl
  extensible collectives library in triton
  ☆90Updated 7 months ago
• meta-pytorch / torchcomms
  torchcomms: a modern PyTorch communications API
  ☆245Updated this week
• Quentin-Anthony / nanoMPI
  Simple MPI implementation for prototyping or learning
  ☆287Updated 3 months ago
• MekkCyber / TritonAcademy
  A repository to unravel the language of GPUs, making their kernel conversations easy to understand
  ☆195Updated 5 months ago
• huggingface / kernel-builder
  👷 Build compute kernels
  ☆171Updated this week
• meta-pytorch / torchforge
  PyTorch-native post-training at scale
  ☆509Updated this week
• gpu-mode / ring-attention
  ring-attention experiments
  ☆155Updated last year
• gpu-mode / profiling-cuda-in-torch
  ☆176Updated last year
• PrimeIntellect-ai / pi-quant
  SIMD quantization kernels
  ☆92Updated 2 months ago
• open-lm-engine / accelerated-model-architectures
  A bunch of kernels that might make stuff slower 😉
  ☆64Updated this week
• NVIDIA / tilus
  Tilus is a tile-level kernel programming language with explicit control over shared memory and registers.
  ☆396Updated this week
• meta-pytorch / tritonparse
  TritonParse: A Compiler Tracer, Visualizer, and Reproducer for Triton Kernels
  ☆169Updated last week
• pytorch / helion
  A Python-embedded DSL that makes it easy to write fast, scalable ML kernels with minimal boilerplate.
  ☆585Updated this week
• apple / ml-recurrent-drafter
  ☆218Updated 9 months ago
• huggingface / kernels
  Load compute kernels from the Hub
  ☆326Updated this week
• facebookresearch / llm-speedrunner
  The Automated LLM Speedrunning Benchmark measures how well LLM agents can reproduce previous innovations and discover new ones in languag…
  ☆111Updated last month