meta-pytorch / MSLKLinks
MSLK (Meta Superintelligence Labs Kernels) is a collection of PyTorch GPU operator libraries that are designed and optimized for GenAI training and inference, such as FP8 row-wise quantization and collective communications.
☆35Updated this week
Alternatives and similar repositories for MSLK
Users that are interested in MSLK are comparing it to the libraries listed below
Sorting:
- FractalTensor is a programming framework that introduces a novel approach to organizing data in deep neural networks (DNNs) as a list of …☆31Updated last year
- TileFusion is an experimental C++ macro kernel template library that elevates the abstraction level in CUDA C for tile processing.☆104Updated 6 months ago
- ☆53Updated 8 months ago
- GPTQ inference TVM kernel☆41Updated last year
- A Triton JIT runtime and ffi provider in C++☆30Updated 3 weeks ago
- ☆65Updated 8 months ago
- Framework to reduce autotune overhead to zero for well known deployments.☆92Updated 4 months ago
- ☆20Updated last year
- Standalone Flash Attention v2 kernel without libtorch dependency☆113Updated last year
- ☆11Updated 4 years ago
- ☆83Updated 7 months ago
- A practical way of learning Swizzle☆36Updated 11 months ago
- A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer☆96Updated 4 months ago
- An extention of TVMScript to write simple and high performance GPU kernels with tensorcore.☆51Updated last year
- TiledLower is a Dataflow Analysis and Codegen Framework written in Rust.☆14Updated last year
- a size profiler for cuda binary☆69Updated this week
- ⚡️Write HGEMM from scratch using Tensor Cores with WMMA, MMA and CuTe API, Achieve Peak⚡️ Performance.☆144Updated 8 months ago
- Persistent dense gemm for Hopper in `CuTeDSL`☆15Updated 5 months ago
- DeeperGEMM: crazy optimized version☆73Updated 8 months ago
- We invite you to visit and follow our new repository at https://github.com/microsoft/TileFusion. TiledCUDA is a highly efficient kernel …☆191Updated 11 months ago
- Artifacts of EVT ASPLOS'24☆28Updated last year
- Benchmark tests supporting the TiledCUDA library.☆18Updated last year
- ☆57Updated this week
- Triton adapter for Ascend. Mirror of https://gitee.com/ascend/triton-ascend☆101Updated this week
- Multiple GEMM operators are constructed with cutlass to support LLM inference.☆20Updated 5 months ago
- ☆40Updated 5 years ago
- study of cutlass☆22Updated last year
- This is a demo how to write a high performance convolution run on apple silicon☆57Updated 3 years ago
- An experimental communicating attention kernel based on DeepEP.☆35Updated 5 months ago
- An extension library of WMMA API (Tensor Core API)☆109Updated last year