Alternatives and similar repositories for turnkeyml:

Users that are interested in turnkeyml are comparing it to the libraries listed below

• microsoft / onnxconverter-common
  Common utilities for ONNX converters
  ☆256Updated last month
• microsoft / onnxscript
  ONNX Script enables developers to naturally author ONNX functions and models using a subset of Python.
  ☆304Updated this week
• mlc-ai / llm-perf-bench
  ☆116Updated 8 months ago
• microsoft / onnxruntime-extensions
  onnxruntime-extensions: A specialized pre- and post- processing library for ONNX Runtime
  ☆349Updated this week
• huggingface / optimum-amd
  AMD related optimizations for transformer models
  ☆63Updated 2 months ago
• mlc-ai / relax
  ☆154Updated 2 weeks ago
• onnx / neural-compressor
  Model compression for ONNX
  ☆80Updated 2 months ago
• huggingface / optimum-habana
  Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)
  ☆165Updated this week
• ROCm / AMDMIGraphX
  AMD's graph optimization engine.
  ☆196Updated this week
• staghado / vit.cpp
  Inference Vision Transformer (ViT) in plain C/C++ with ggml
  ☆244Updated 9 months ago
• tenstorrent / tt-buda-demos
  Repository of model demos using TT-Buda
  ☆60Updated last month
• amd / ZenDNN
  ☆99Updated 2 months ago
• huggingface / optimum-intel
  🤗 Optimum Intel: Accelerate inference with Intel optimization tools
  ☆430Updated this week
• justinchuby / model-explorer-onnx
  ONNX Adapter for model-explorer
  ☆25Updated 3 months ago
• triton-lang / triton-cpu
  An experimental CPU backend for Triton
  ☆75Updated this week
• pytorch-labs / triton-cpu
  An experimental CPU backend for Triton (https//github.com/openai/triton)
  ☆37Updated 8 months ago
• neuralmagic / nm-vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆257Updated 3 months ago
• mobiusml / gemlite
  Fast low-bit matmul kernels in Triton
  ☆187Updated last week
• apple / ml-recurrent-drafter
  ☆185Updated last month
• intel / intel-extension-for-deepspeed
  Intel® Extension for DeepSpeed* is an extension to DeepSpeed that brings feature support with SYCL kernels on Intel GPU(XPU) device. Note…
  ☆58Updated last month
• Xilinx / inference-server
  ☆43Updated 6 months ago
• groq / mlagility
  Machine Learning Agility (MLAgility) benchmark and benchmarking tools
  ☆38Updated last month
• NVIDIA / Fuser
  A Fusion Code Generator for NVIDIA GPUs (commonly known as "nvFuser")
  ☆291Updated this week
• nod-ai / SHARK-ModelDev
  Unified compiler/runtime for interfacing with PyTorch Dynamo.
  ☆99Updated this week
• IST-DASLab / QUIK
  Repository for the QUIK project, enabling the use of 4bit kernels for generative inference - EMNLP 2024
  ☆175Updated 9 months ago
• NVIDIA / Deep-Learning-Accelerator-SW
  NVIDIA DLA-SW, the recipes and tools for running deep learning workloads on NVIDIA DLA cores for inference applications.
  ☆187Updated 7 months ago
• EmbeddedLLM / vllm
  vLLM: A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆88Updated this week
• usyd-fsalab / fp6_llm
  An efficient GPU support for LLM inference with x-bit quantization (e.g. FP6,FP5).
  ☆230Updated 2 months ago
• neuralmagic / compressed-tensors
  A safetensors extension to efficiently store sparse quantized tensors on disk
  ☆64Updated this week
• intel / ai-containers
  This repository contains Dockerfiles, scripts, yaml files, Helm charts, etc. used to scale out AI containers with versions of TensorFlow …
  ☆34Updated this week