Alternatives and similar repositories for mlas

Users that are interested in mlas are comparing it to the libraries listed below

• josephrocca / onnxscript-editor
  ONNX Script editor & visualiser running completely in the browser thanks to Pyodide and Netron
  ☆20Updated 2 years ago
• lrw04 / tinyllamas-ncnn
  Inference TinyLlama models on ncnn
  ☆24Updated last year
• kyutai-labs / jax-flash-attn3
  JAX bindings for the flash-attention3 kernels
  ☆11Updated 10 months ago
• microsoft / onnxruntime-tvm
  Open deep learning compiler stack for cpu, gpu and specialized accelerators
  ☆34Updated 2 years ago
• apple / ml-acn-embed
  Acoustic Neighbor Embeddings
  ☆24Updated 6 months ago
• DayBreak-u / seq2seq_ncnn
  the C++ version of Seq2Seq with ncnn
  ☆23Updated 4 years ago
• EdVince / llm-cpp
  ☆32Updated 11 months ago
• EdVince / whisper-trtllm
  Whisper in TensorRT-LLM
  ☆16Updated last year
• google-research / mozolm
  MozoLM: A language model (LM) serving library
  ☆45Updated 4 months ago
• isEmmanuelOlowe / llm-cost-estimator
  Estimating hardware and cloud costs of LLMs and transformer projects
  ☆17Updated this week
• google-ai-edge / ai-edge-quantizer
  AI Edge Quantizer: flexible post training quantization for LiteRT models.
  ☆49Updated this week
• catid / bitnet_cpu
  Experiments with BitNet inference on CPU
  ☆54Updated last year
• pytorch-labs / tokenizers
  C++ implementations for various tokenizers (sentencepiece, tiktoken etc).
  ☆31Updated last week
• GindaChen / FlexFlashAttention3
  FlexAttention w/ FlashAttention3 Support
  ☆26Updated 8 months ago
• kyegomez / MM1
  PyTorch Implementation of the paper "MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training"
  ☆24Updated last month
• chips-compilers-mlsys-21 / chips-compilers-mlsys-21.github.io
  ☆11Updated 4 years ago
• graphcore-research / unit-scaling-demo
  Unit Scaling demo and experimentation code
  ☆16Updated last year
• BBuf / tensorrt-llm-moe
  ☆29Updated 4 months ago
• tile-ai / tvm
  Open deep learning compiler stack for cpu, gpu and specialized accelerators
  ☆19Updated this week
• facebookresearch / llama-hd-dataset
  This is a balanced dataset for English homograph disambiguation (HD), generated with Meta's Llama 2-Chat 70B model.
  ☆18Updated last year
• futz12 / uie_ncnn_windows
  UIE(Universal Information Extraction) infer by ncnn
  ☆12Updated 9 months ago
• ptillet / triton-llvm-releases
  ☆21Updated last year
• Naozumi520 / g2pW-Cantonese
  Cantonese Grapheme-to-Phoneme Converter based on GitYCC/g2pW
  ☆13Updated 6 months ago
• ggerganov / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆26Updated last year
• uthree / ddsp-vocoder
  ☆10Updated 7 months ago
• daquexian / faster-rwkv
  ☆124Updated last year
• zhaohb / MeloTTS-OV
  Using OpenVINO to speed up MeloTTS inference
  ☆11Updated 7 months ago
• ARM-software / kleidiai
  This repository is a read-only mirror of https://gitlab.arm.com/kleidi/kleidiai
  ☆51Updated last week
• morousg / cvGPUSpeedup
  A faster implementation of OpenCV-CUDA that uses OpenCV objects, and more!
  ☆51Updated this week
• casper-hansen / AutoAWQ_kernels
  ☆74Updated 7 months ago