ROCm / pyrsmi

Related projects ⓘ

Alternatives and complementary repositories for pyrsmi

• microsoft / DeepSpeed-Kernels
  ☆55Updated 5 months ago
• cchan / tccl
  extensible collectives library in triton
  ☆72Updated last month
• IST-DASLab / SparseFinetuning
  Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry
  ☆38Updated 10 months ago
• triton-lang / kernels
  ☆45Updated 2 weeks ago
• wangsiping97 / FastGEMV
  High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.
  ☆90Updated 4 months ago
• neuralmagic / compressed-tensors
  A safetensors extension to efficiently store sparse quantized tensors on disk
  ☆50Updated this week
• stanford-futuredata / stk
  ☆88Updated 2 months ago
• ROCm / aotriton
  Ahead of Time (AOT) Triton Math Library
  ☆41Updated this week
• mlc-ai / xgrammar
  Efficient, Flexible and Portable Structured Generation
  ☆53Updated this week
• IBM / triton-dejavu
  Framework to reduce autotune overhead to zero for well known deployments.
  ☆20Updated this week
• ROCm / triton
  Development repository for the Triton language and compiler
  ☆93Updated this week
• tgale96 / grouped_gemm
  PyTorch bindings for CUTLASS grouped GEMM.
  ☆53Updated 3 weeks ago
• pytorch-labs / applied-ai
  Applied AI experiments and examples for PyTorch
  ☆166Updated 3 weeks ago
• mlcommons / logging
  MLPerf™ logging library
  ☆30Updated this week
• pytorch-labs / triton-cpu
  An experimental CPU backend for Triton (https//github.com/openai/triton)
  ☆35Updated 6 months ago
• IST-DASLab / QIGen
  Repository for CPU Kernel Generation for LLM Inference
  ☆25Updated last year
• graphcore-research / out-of-the-box-fp8-training
  Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.
  ☆35Updated 4 months ago
• yifuwang / symm-mem-recipes
  ☆12Updated last month
• facebookresearch / MODel_opt
  Memory Optimizations for Deep Learning (ICML 2023)
  ☆60Updated 8 months ago
• apple / ml-recurrent-drafter
  ☆99Updated last month
• intel / intel-extension-for-deepspeed
  Intel® Extension for DeepSpeed* is an extension to DeepSpeed that brings feature support with SYCL kernels on Intel GPU(XPU) device. Note…
  ☆57Updated 2 months ago
• intel / torch-xpu-ops
  ☆30Updated this week
• groq / mlagility
  Machine Learning Agility (MLAgility) benchmark and benchmarking tools
  ☆38Updated 3 weeks ago
• INT-FlashAttention2024 / INT-FlashAttention
  ☆47Updated 2 months ago
• LeiWang1999 / AutoGPTQ.tvm
  GPTQ inference TVM kernel
  ☆36Updated 6 months ago
• sgl-project / tensorrt-demo
  TensorRT LLM Benchmark Configuration
  ☆11Updated 3 months ago
• DachengLi1 / AMP
  (NeurIPS 2022) Automatically finding good model-parallel strategies, especially for complex models and clusters.
  ☆34Updated 2 years ago
• iree-org / iree-nvgpu
  ☆48Updated 8 months ago
• mobiusml / gemlite
  Simple and fast low-bit matmul kernels in CUDA / Triton
  ☆145Updated this week
• ROCm / rccl-tests
  RCCL Performance Benchmark Tests
  ☆50Updated 3 weeks ago