matrix97317 / OneNeuralNetworkLinks
This is a cross-chip platform collection of operators and a unified neural network library.
☆17Updated last year
Alternatives and similar repositories for OneNeuralNetwork
Users that are interested in OneNeuralNetwork are comparing it to the libraries listed below
Sorting:
- ⚡️Write HGEMM from scratch using Tensor Cores with WMMA, MMA and CuTe API, Achieve Peak⚡️ Performance.☆80Updated last month
- ☆97Updated 2 months ago
- A prefill & decode disaggregated LLM serving framework with shared GPU memory and fine-grained compute isolation.☆87Updated last month
- An unofficial cuda assembler, for all generations of SASS, hopefully :)☆83Updated 2 years ago
- Solutions of LeetGPU☆27Updated last week
- A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer☆92Updated 3 weeks ago
- ☆14Updated 3 years ago
- Examples of CUDA implementations by Cutlass CuTe☆197Updated 4 months ago
- ☆70Updated 2 years ago
- 分层解耦的深度学习推理引擎☆73Updated 4 months ago
- ☆80Updated last month
- We invite you to visit and follow our new repository at https://github.com/microsoft/TileFusion. TiledCUDA is a highly efficient kernel …☆183Updated 5 months ago
- 使用 cutlass 仓库在 ada 架构上实现 fp8 的 flash attention☆71Updated 10 months ago
- play gemm with tvm☆91Updated last year
- Triton Compiler related materials.☆30Updated 5 months ago
- ☆113Updated last year
- A tutorial for CUDA&PyTorch☆146Updated 5 months ago
- ☆27Updated last year
- ☆146Updated 6 months ago
- ☆148Updated 5 months ago
- FlagTree is a unified compiler for multiple AI chips, which is forked from triton-lang/triton.☆53Updated this week
- A benchmark suited especially for deep learning operators☆42Updated 2 years ago
- Optimize GEMM with tensorcore step by step☆26Updated last year
- ☆97Updated 9 months ago
- Summary of the Specs of Commonly Used GPUs for Training and Inference of LLM☆46Updated 3 months ago
- a tensor computing compiler based tile programming for gpu, cpu or tpu☆43Updated this week
- hands on model tuning with TVM and profile it on a Mac M1, x86 CPU, and GTX-1080 GPU.☆48Updated 2 years ago
- Personal Notes for Learning HPC & Parallel Computation [Active Adding New Content]☆67Updated 2 years ago
- Summary of some awesome work for optimizing LLM inference☆77Updated 3 weeks ago
- Implement Flash Attention using Cute.☆87Updated 6 months ago