Alternatives and similar repositories for turnkeyml:

Users that are interested in turnkeyml are comparing it to the libraries listed below

• ROCm / aiter
  AI Tensor Engine for ROCm
  ☆160Updated this week
• intel / neural-speed
  An innovative library for efficient LLM inference via low-bit quantization
  ☆352Updated 7 months ago
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆87Updated this week
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆276Updated this week
• intel / intel-xpu-backend-for-triton
  OpenAI Triton backend for Intel® GPUs
  ☆178Updated this week
• mlc-ai / llm-perf-bench
  ☆118Updated 11 months ago
• ROCm / triton
  Development repository for the Triton language and compiler
  ☆118Updated this week
• ROCm / hipBLASLt
  hipBLASLt is a library that provides general matrix-matrix operations with a flexible API and extends functionalities beyond a traditiona…
  ☆86Updated this week
• mlc-ai / relax
  ☆156Updated 2 weeks ago
• onnx / neural-compressor
  Model compression for ONNX
  ☆91Updated 5 months ago
• microsoft / BitBLAS
  BitBLAS is a library to support mixed-precision matrix multiplications, especially for quantized LLM deployment.
  ☆579Updated 2 months ago
• justinchuby / onnx-safetensors
  Use safetensors with ONNX 🤗
  ☆50Updated last month
• apple / ml-recurrent-drafter
  ☆207Updated 2 months ago
• neuralmagic / nm-vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆262Updated 6 months ago
• amd / UIF
  ☆60Updated last year
• IST-DASLab / QUIK
  Repository for the QUIK project, enabling the use of 4bit kernels for generative inference - EMNLP 2024
  ☆179Updated last year
• mobiusml / gemlite
  Fast low-bit matmul kernels in Triton
  ☆288Updated this week
• Cornell-RelaxML / qtip
  ☆122Updated 3 weeks ago
• tenstorrent / tt-buda-demos
  Repository of model demos using TT-Buda
  ☆63Updated 2 weeks ago
• intel / auto-round
  Advanced Quantization Algorithm for LLMs/VLMs.
  ☆427Updated this week
• amd / ZenDNN
  ☆105Updated last week
• SearchSavior / OpenArc
  Lightweight Inference server for OpenVINO
  ☆152Updated this week
• microsoft / onnxscript
  ONNX Script enables developers to naturally author ONNX functions and models using a subset of Python.
  ☆337Updated this week
• ROCm / vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆72Updated this week
• Repeerc / flash-attention-v2-RDNA3-minimal
  a simple Flash Attention v2 implementation with ROCM (RDNA3 GPU, roc wmma), mainly used for stable diffusion(ComfyUI) in Windows ZLUDA en…
  ☆37Updated 7 months ago
• openvinotoolkit / openvino_tokenizers
  OpenVINO Tokenizers extension
  ☆32Updated last week
• ROCm / AMDMIGraphX
  AMD's graph optimization engine.
  ☆214Updated this week
• oneapi-src / SYCLomatic
  ☆250Updated this week
• intel / ai-containers
  This repository contains Dockerfiles, scripts, yaml files, Helm charts, etc. used to scale out AI containers with versions of TensorFlow …
  ☆42Updated this week
• salykova / sgemm.cu
  High-Performance SGEMM on CUDA devices
  ☆90Updated 2 months ago