Alternatives and similar repositories for turnkeyml

Users that are interested in turnkeyml are comparing it to the libraries listed below

• ROCm / aiter
  AI Tensor Engine for ROCm
  ☆208Updated this week
• lemonade-sdk / lemonade
  Local LLM Server with GPU and NPU Acceleration
  ☆138Updated this week
• SearchSavior / OpenArc
  Lightweight Inference server for OpenVINO
  ☆187Updated last week
• amd / ryzen-ai-documentation
  Onboarding documentation source for the AMD Ryzen™ AI Software Platform. The AMD Ryzen™ AI Software Platform enables developers to take…
  ☆66Updated this week
• openvinotoolkit / openvino.genai
  Run Generative AI models with simple C++/Python API and using OpenVINO Runtime
  ☆293Updated this week
• amd / gaia
  Run LLM Agents on Ryzen AI PCs in Minutes
  ☆421Updated last week
• ROCm / TheRock
  The HIP Environment and ROCm Kit - A lightweight open source build system for HIP and ROCm
  ☆177Updated this week
• intel / neural-speed
  An innovative library for efficient LLM inference via low-bit quantization
  ☆349Updated 9 months ago
• ikawrakow / ik_llama.cpp
  llama.cpp fork with additional SOTA quants and improved performance
  ☆608Updated this week
• ROCm / hipBLASLt
  [DEPRECATED] Moved to ROCm/rocm-libraries repo
  ☆106Updated this week
• huggingface / optimum-intel
  🤗 Optimum Intel: Accelerate inference with Intel optimization tools
  ☆473Updated last week
• neuralmagic / nm-vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆264Updated 8 months ago
• intel / intel-xpu-backend-for-triton
  OpenAI Triton backend for Intel® GPUs
  ☆191Updated this week
• amd / ZenDNN
  ☆108Updated last week
• intel / auto-round
  Advanced Quantization Algorithm for LLMs and VLMs, with support for CPU, Intel GPU, CUDA and HPU. Seamlessly integrated with Torchao, Tra…
  ☆525Updated this week
• huggingface / optimum-amd
  AMD related optimizations for transformer models
  ☆79Updated 7 months ago
• amd / RyzenAI-SW
  ☆541Updated last month
• ROCm / triton
  Development repository for the Triton language and compiler
  ☆125Updated this week
• justinchuby / onnx-safetensors
  Use safetensors with ONNX 🤗
  ☆63Updated 3 months ago
• mlc-ai / relax
  ☆158Updated last week
• microsoft / BitBLAS
  BitBLAS is a library to support mixed-precision matrix multiplications, especially for quantized LLM deployment.
  ☆629Updated last month
• ROCm / flash-attention
  Fast and memory-efficient exact attention
  ☆174Updated this week
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆87Updated this week
• microsoft / onnxruntime-genai
  Generative AI extensions for onnxruntime
  ☆740Updated this week
• neuralmagic / compressed-tensors
  A safetensors extension to efficiently store sparse quantized tensors on disk
  ☆129Updated this week
• wejoncy / QLLM
  A general 2-8 bits quantization toolbox with GPTQ/AWQ/HQQ/VPTQ, and export to onnx/onnx-runtime easily.
  ☆172Updated 2 months ago
• powerserve-project / PowerServe
  High-speed and easy-use LLM serving framework for local deployment
  ☆112Updated 3 months ago
• ROCm / rocm-examples
  A collection of examples for the ROCm software stack
  ☆224Updated this week
• intel / intel-npu-acceleration-library
  Intel® NPU Acceleration Library
  ☆680Updated 2 months ago
• ROCm / vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆84Updated this week