Alternatives and similar repositories for mlas:

Users that are interested in mlas are comparing it to the libraries listed below

• josephrocca / onnxscript-editor
  ONNX Script editor & visualiser running completely in the browser thanks to Pyodide and Netron
  ☆20Updated 2 years ago
• deepspeedai / DeepSpeed-Kernels
  ☆65Updated last week
• lrw04 / tinyllamas-ncnn
  Inference TinyLlama models on ncnn
  ☆24Updated last year
• google-research / mozolm
  MozoLM: A language model (LM) serving library
  ☆44Updated last month
• facebookresearch / loop_nest
  Loop Nest - Linear algebra compiler and code generator.
  ☆22Updated 2 years ago
• DayBreak-u / seq2seq_ncnn
  the C++ version of Seq2Seq with ncnn
  ☆23Updated 3 years ago
• microsoft / onnxruntime-tvm
  Open deep learning compiler stack for cpu, gpu and specialized accelerators
  ☆34Updated 2 years ago
• frozein / QuickMathHPP
  a single-header math library
  ☆16Updated 6 months ago
• daquexian / faster-rwkv
  ☆124Updated last year
• ROCm / rpp
  AMD ROCm Performance Primitives (RPP) library is a comprehensive high-performance computer vision library for AMD processors with HIP/Ope…
  ☆59Updated this week
• jinmingyi1998 / opencl_kernels
  An easy way to run, test, benchmark and tune OpenCL kernel files
  ☆23Updated last year
• graphcore-research / unit-scaling-demo
  Unit Scaling demo and experimentation code
  ☆16Updated last year
• GindaChen / FlexFlashAttention3
  FlexAttention w/ FlashAttention3 Support
  ☆26Updated 6 months ago
• ARM-software / kleidiai
  This repository is a read-only mirror of https://gitlab.arm.com/kleidi/kleidiai
  ☆27Updated this week
• tile-ai / tvm
  Open deep learning compiler stack for cpu, gpu and specialized accelerators
  ☆18Updated this week
• openvinotoolkit / openvino_tokenizers
  OpenVINO Tokenizers extension
  ☆31Updated this week
• MollySophia / rwkv-qualcomm
  Inference RWKV v5, v6 and v7 with Qualcomm AI Engine Direct SDK
  ☆62Updated last week
• nod-ai / transformer-benchmarks
  benchmarking some transformer deployments
  ☆26Updated 2 years ago
• kpu / intgemm
  int8_t and int16_t matrix multiply based on https://arxiv.org/abs/1705.01991
  ☆69Updated last year
• microsoft / torchy
  A tracing JIT for PyTorch
  ☆17Updated 2 years ago
• hisrg / SNPE
  Snapdragon Neural Processing Engine (SNPE) SDKThe Snapdragon Neural Processing Engine (SNPE) is a Qualcomm Snapdragon software accelerate…
  ☆34Updated 2 years ago
• enp1s0 / ozIMMU
  FP64 equivalent GEMM via Int8 Tensor Cores using the Ozaki scheme
  ☆57Updated 2 weeks ago
• apple / ml-acn-embed
  Acoustic Neighbor Embeddings
  ☆21Updated 3 months ago
• catid / bitnet_cpu
  Experiments with BitNet inference on CPU
  ☆53Updated last year
• pytorch-labs / triton-cpu
  An experimental CPU backend for Triton (https//github.com/openai/triton)
  ☆40Updated 2 weeks ago
• daquexian / web-model-converter
  ☆40Updated 2 years ago
• mikex86 / tritonc
  Standalone commandline CLI tool for compiling Triton kernels
  ☆17Updated 6 months ago
• EdVince / whisper-trtllm
  Whisper in TensorRT-LLM
  ☆15Updated last year
• onnx / onnx-xla
  XLA integration of Open Neural Network Exchange (ONNX)
  ☆19Updated 6 years ago
• isEmmanuelOlowe / llm-cost-estimator
  Estimating hardware and cloud costs of LLMs and transformer projects
  ☆14Updated last year