Alternatives and similar repositories for turnkeyml:

Users that are interested in turnkeyml are comparing it to the libraries listed below

• microsoft / onnxscript
  ONNX Script enables developers to naturally author ONNX functions and models using a subset of Python.
  ☆317Updated this week
• ROCm / AMDMIGraphX
  AMD's graph optimization engine.
  ☆208Updated this week
• ROCm / hipBLASLt
  hipBLASLt is a library that provides general matrix-matrix operations with a flexible API and extends functionalities beyond a traditiona…
  ☆79Updated this week
• microsoft / onnxconverter-common
  Common utilities for ONNX converters
  ☆259Updated 2 months ago
• mobiusml / gemlite
  Fast low-bit matmul kernels in Triton
  ☆236Updated this week
• salykova / sgemm.cu
  High-Performance SGEMM on CUDA devices
  ☆74Updated 3 weeks ago
• amd / UIF
  ☆58Updated last year
• amd / ZenDNN
  ☆105Updated 3 months ago
• nod-ai / SHARK-ModelDev
  Unified compiler/runtime for interfacing with PyTorch Dynamo.
  ☆100Updated this week
• huggingface / optimum-amd
  AMD related optimizations for transformer models
  ☆67Updated 3 months ago
• onnx / neural-compressor
  Model compression for ONNX
  ☆86Updated 3 months ago
• neuralmagic / nm-vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆259Updated 4 months ago
• intel / intel-xpu-backend-for-triton
  OpenAI Triton backend for Intel® GPUs
  ☆165Updated this week
• pytorch-labs / triton-cpu
  An experimental CPU backend for Triton (https//github.com/openai/triton)
  ☆38Updated 9 months ago
• microsoft / BitBLAS
  BitBLAS is a library to support mixed-precision matrix multiplications, especially for quantized LLM deployment.
  ☆523Updated last week
• intel / intel-extension-for-deepspeed
  Intel® Extension for DeepSpeed* is an extension to DeepSpeed that brings feature support with SYCL kernels on Intel GPU(XPU) device. Note…
  ☆60Updated 2 months ago
• intel / auto-round
  Advanced Quantization Algorithm for LLMs/VLMs.
  ☆372Updated this week
• intel / neural-speed
  An innovative library for efficient LLM inference via low-bit quantization
  ☆351Updated 5 months ago
• onnx / steering-committee
  Notes and artifacts from the ONNX steering committee
  ☆25Updated this week
• gevtushenko / llm.c
  LLM training in simple, raw C/CUDA
  ☆91Updated 9 months ago
• intel / torch-xpu-ops
  ☆34Updated this week
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆88Updated this week
• mlc-ai / relax
  ☆157Updated last week
• microsoft / onnxruntime-extensions
  onnxruntime-extensions: A specialized pre- and post- processing library for ONNX Runtime
  ☆360Updated this week
• ROCm / triton
  Development repository for the Triton language and compiler
  ☆107Updated this week
• usyd-fsalab / fp6_llm
  An efficient GPU support for LLM inference with x-bit quantization (e.g. FP6,FP5).
  ☆234Updated 3 months ago
• openvinotoolkit / openvino_tokenizers
  OpenVINO Tokenizers extension
  ☆29Updated this week
• microsoft / ark
  A GPU-driven system framework for scalable AI applications
  ☆112Updated 2 weeks ago
• pytorch / tlparse
  TORCH_LOGS parser for PT2
  ☆32Updated this week
• apple / ml-recurrent-drafter
  ☆197Updated 3 weeks ago