ARM-software / kleidiaiLinks
This repository is a read-only mirror of https://gitlab.arm.com/kleidi/kleidiai
☆62Updated 2 weeks ago
Alternatives and similar repositories for kleidiai
Users that are interested in kleidiai are comparing it to the libraries listed below
Sorting:
- BitBLAS is a library to support mixed-precision matrix multiplications, especially for quantized LLM deployment.☆654Updated 3 weeks ago
- FlagTree is a unified compiler for multiple AI chips, which is forked from triton-lang/triton.☆67Updated this week
- ☆161Updated 2 weeks ago
- An experimental CPU backend for Triton☆138Updated 2 months ago
- High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.☆113Updated last year
- PyTorch extension for emulating FP8 data formats on standard FP32 Xeon/GPU hardware.☆110Updated 8 months ago
- ☆154Updated 2 years ago
- An efficient GPU support for LLM inference with x-bit quantization (e.g. FP6,FP5).☆260Updated 3 weeks ago
- PyTorch emulation library for Microscaling (MX)-compatible data formats☆262Updated last month
- ☆79Updated 6 months ago
- Benchmark code for the "Online normalizer calculation for softmax" paper☆95Updated 7 years ago
- ⚡️FFPA: Extend FlashAttention-2 with Split-D, achieve ~O(1) SRAM complexity for large headdim, 1.8x~3x↑ vs SDPA.🎉☆194Updated 2 months ago
- This is a demo how to write a high performance convolution run on apple silicon☆54Updated 3 years ago
- We invite you to visit and follow our new repository at https://github.com/microsoft/TileFusion. TiledCUDA is a highly efficient kernel …☆183Updated 6 months ago
- CUDA Matrix Multiplication Optimization☆213Updated last year
- Several optimization methods of half-precision general matrix vector multiplication (HGEMV) using CUDA core.☆63Updated 10 months ago
- mperf是一个面向移动/嵌入式平台的算子性能调优工具箱☆188Updated last year
- ☆72Updated 9 months ago
- A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer☆94Updated 3 weeks ago
- OpenAI Triton backend for Intel® GPUs☆197Updated this week
- ⚡️Write HGEMM from scratch using Tensor Cores with WMMA, MMA and CuTe API, Achieve Peak⚡️ Performance.☆93Updated 2 months ago
- Code for ACM MobiCom 2024 paper "FlexNN: Efficient and Adaptive DNN Inference on Memory-Constrained Edge Devices"☆54Updated 6 months ago
- ☆172Updated last year
- Standalone Flash Attention v2 kernel without libtorch dependency☆111Updated 10 months ago
- llama INT4 cuda inference with AWQ☆54Updated 6 months ago
- ☆37Updated last year
- TileFusion is an experimental C++ macro kernel template library that elevates the abstraction level in CUDA C for tile processing.☆93Updated last month
- ☆64Updated last year
- 📚 A curated list of awesome matrix-matrix multiplication (A * B = C) frameworks, libraries and software☆51Updated 5 months ago
- ☆150Updated last year