Alternatives and similar repositories for llm_parallelisms.c

Users that are interested in llm_parallelisms.c are comparing it to the libraries listed below

• open-lm-engine / flash-model-architectures
  A bunch of kernels that might make stuff slower 😉
  ☆59Updated this week
• gpu-mode / discord-cluster-manager
  Write a fast kernel and run it on Discord. See how you compare against the best!
  ☆57Updated this week
• triton-lang / kernels
  ☆88Updated 10 months ago
• zinccat / Awesome-Triton-Kernels
  Collection of kernels written in Triton language
  ☆154Updated 5 months ago
• IBM / triton-dejavu
  Framework to reduce autotune overhead to zero for well known deployments.
  ☆82Updated this week
• daniel-geon-park / triton_bwd
  Automatic differentiation for Triton Kernels
  ☆11Updated last month
• gpu-mode / triton-index
  Cataloging released Triton kernels.
  ☆257Updated last week
• gpu-mode / ring-attention
  ring-attention experiments
  ☆152Updated 11 months ago
• Jokeren / triton-samples
  ☆28Updated 8 months ago
• simveit / effective_transpose
  Effective transpose on Hopper GPU
  ☆23Updated 2 weeks ago
• Deep-Learning-Profiling-Tools / triton-viz
  ☆234Updated last week
• gpu-mode / popcorn-cli
  ☆42Updated this week
• meta-pytorch / tritonparse
  TritonParse: A Compiler Tracer, Visualizer, and mini-Reproducer Generator(WIP) for Triton Kernels
  ☆150Updated this week
• IST-DASLab / Sparse-Marlin
  Boosting 4-bit inference kernels with 2:4 Sparsity
  ☆82Updated last year
• Deep-Learning-Profiling-Tools / triton-samples
  ☆14Updated 6 months ago
• MekkCyber / CutlassAcademy
  A curated collection of resources, tutorials, and best practices for learning and mastering NVIDIA CUTLASS
  ☆221Updated 4 months ago
• cchan / tccl
  extensible collectives library in triton
  ☆87Updated 5 months ago
• hpcaitech / TensorNVMe
  A Python library transfers PyTorch tensors between CPU and NVMe
  ☆121Updated 9 months ago
• mobiusml / gemlite
  Fast low-bit matmul kernels in Triton
  ☆365Updated last week
• microsoft / TileFusion
  TileFusion is an experimental C++ macro kernel template library that elevates the abstraction level in CUDA C for tile processing.
  ☆97Updated 2 months ago
• gpu-mode / reference-kernels
  Official Problem Sets / Reference Kernels for the GPU MODE Leaderboard!
  ☆92Updated this week
• meta-pytorch / tritonbench
  Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.
  ☆223Updated this week
• meta-pytorch / kraken
  Triton-based Symmetric Memory operators and examples
  ☆28Updated 3 weeks ago
• gau-nernst / learn-cuda
  Learn CUDA with PyTorch
  ☆78Updated this week
• NVIDIA / jaxpp
  JaxPP is a library for JAX that enables flexible MPMD pipeline parallelism for large-scale LLM training
  ☆53Updated last month
• ROCm / iris
  AMD RAD's experimental RMA library for Triton.
  ☆63Updated this week
• facebookresearch / MODel_opt
  Memory Optimizations for Deep Learning (ICML 2023)
  ☆107Updated last year
• stanford-futuredata / stk
  ☆111Updated last year
• gau-nernst / quantized-training
  Explore training for quantized models
  ☆24Updated 2 months ago
• google-research-datasets / tpu_graphs
  ☆125Updated last year