bytedance / byteir
A model compilation solution for various hardware
☆424Updated last week
Alternatives and similar repositories for byteir:
Users that are interested in byteir are comparing it to the libraries listed below
- Development repository for the Triton-Linalg conversion☆185Updated 2 months ago
- Shared Middle-Layer for Triton Compilation☆245Updated this week
- ☆192Updated 2 years ago
- An MLIR-based compiler framework bridges DSLs (domain-specific languages) to DSAs (domain-specific architectures).☆584Updated 2 weeks ago
- AI Accelerator Benchmark focuses on evaluating AI Accelerators from a practical production perspective, including the ease of use and ver…☆236Updated this week
- ☆410Updated this week
- Yinghan's Code Sample☆323Updated 2 years ago
- Several optimization methods of half-precision general matrix multiplication (HGEMM) using tensor core with WMMA API and MMA PTX instruct…☆393Updated 7 months ago
- A Easy-to-understand TensorOp Matmul Tutorial☆342Updated 7 months ago
- FlagGems is an operator library for large language models implemented in Triton Language.☆496Updated this week
- A home for the final text of all TVM RFCs.☆102Updated 6 months ago
- An unofficial cuda assembler, for all generations of SASS, hopefully :)☆483Updated 2 years ago
- A simple high performance CUDA GEMM implementation.☆361Updated last year
- BladeDISC is an end-to-end DynamIc Shape Compiler project for machine learning workloads.☆861Updated 3 months ago
- Optimizing SGEMM kernel functions on NVIDIA GPUs to a close-to-cuBLAS performance.☆337Updated 3 months ago
- Distributed Triton for Parallel Systems☆451Updated 2 weeks ago
- Play with MLIR right in your browser☆134Updated last year
- row-major matmul optimization☆624Updated last year
- Assembler for NVIDIA Volta and Turing GPUs☆217Updated 3 years ago
- MegCC是一个运行时超轻量,高效,移植简单的深度学习模型编译器☆482Updated 5 months ago
- Hands-On Practical MLIR Tutorial☆447Updated last year
- ☆148Updated 3 months ago
- optimized BERT transformer inference on NVIDIA GPU. https://arxiv.org/abs/2210.03052☆472Updated last year
- collection of benchmarks to measure basic GPU capabilities☆359Updated 2 months ago
- heterogeneity-aware-lowering-and-optimization☆255Updated last year
- A flexible and efficient deep neural network (DNN) compiler that generates high-performance executable from a DNN model description.☆981Updated 7 months ago
- We invite you to visit and follow our new repository at https://github.com/microsoft/TileFusion. TiledCUDA is a highly efficient kernel …☆181Updated 2 months ago
- GLake: optimizing GPU memory management and IO transmission.☆456Updated 3 weeks ago
- Dynamic Memory Management for Serving LLMs without PagedAttention☆348Updated this week
- Efficient operation implementation based on the Cambricon Machine Learning Unit (MLU) .☆115Updated 2 weeks ago