Alternatives and similar repositories for openvino_devtools

Users that are interested in openvino_devtools are comparing it to the libraries listed below

• openvinotoolkit / openvino.genai
  Run Generative AI models with simple C++/Python API and using OpenVINO Runtime
  ☆381Updated this week
• huggingface / optimum-intel
  🤗 Optimum Intel: Accelerate inference with Intel optimization tools
  ☆515Updated this week
• openvinotoolkit / nncf
  Neural Network Compression Framework for enhanced OpenVINO™ inference
  ☆1,109Updated this week
• intel / intel-extension-for-pytorch
  A Python package for extending the official PyTorch that can easily obtain performance on Intel platform
  ☆1,993Updated last week
• libxsmm / tpp-pytorch-extension
  Intel® Tensor Processing Primitives extension for Pytorch*
  ☆17Updated last week
• openvinotoolkit / openvino_tokenizers
  OpenVINO Tokenizers extension
  ☆43Updated last week
• intel / intel-xpu-backend-for-triton
  OpenAI Triton backend for Intel® GPUs
  ☆221Updated this week
• openvinotoolkit / npu_compiler
  OpenVINO Intel NPU Compiler
  ☆73Updated 2 weeks ago
• intel / xpumanager
  ☆142Updated last week
• intel / intel-npu-acceleration-library
  Intel® NPU Acceleration Library
  ☆700Updated 7 months ago
• intel / neural-compressor
  SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, …
  ☆2,537Updated this week
• intel / sycl-tla
  SYCL* Templates for Linear Algebra (SYCL*TLA) - SYCL based CUTLASS implementation for Intel GPUs
  ☆58Updated this week
• vllm-project / vllm-openvino
  ☆27Updated 3 months ago
• openvinotoolkit / model_server
  A scalable inference server for models optimized with OpenVINO™
  ☆800Updated this week
• NVIDIA / TensorRT-Incubator
  Experimental projects related to TensorRT
  ☆116Updated this week
• microsoft / onnxruntime-genai
  Generative AI extensions for onnxruntime
  ☆901Updated this week
• ROCm / rocmProfileData
  ☆27Updated 2 months ago
• NVIDIA / TensorRT-Model-Optimizer
  A unified library of SOTA model optimization techniques like quantization, pruning, distillation, speculative decoding, etc. It compresse…
  ☆1,605Updated this week
• ROCm / composable_kernel
  Composable Kernel: Performance Portable Programming Model for Machine Learning Tensor Operators
  ☆492Updated this week
• ThanatosShinji / onnx-tool
  A parser, editor and profiler tool for ONNX models.
  ☆469Updated last month
• mlc-ai / tokenizers-cpp
  Universal cross-platform tokenizers binding to HF and sentencepiece
  ☆426Updated 4 months ago
• intel / intel-xai-tools
  Explainable AI Tooling (XAI). XAI is used to discover and explain a model's prediction in a way that is interpretable to the user. Releva…
  ☆38Updated 2 months ago
• NVIDIA / cudnn-frontend
  cudnn_frontend provides a c++ wrapper for the cudnn backend API and samples on how to use it
  ☆652Updated this week
• intel / xFasterTransformer
  ☆431Updated 2 months ago
• intel / intel-extension-for-deepspeed
  Intel® Extension for DeepSpeed* is an extension to DeepSpeed that brings feature support with SYCL kernels on Intel GPU(XPU) device. Note…
  ☆63Updated 5 months ago
• microsoft / onnxconverter-common
  Common utilities for ONNX converters
  ☆287Updated 3 months ago
• microsoft / onnxscript
  ONNX Script enables developers to naturally author ONNX functions and models using a subset of Python.
  ☆412Updated this week
• intel / edge-insights-vision
  Edge Insights for Vision (eiv) is a package that helps to auto install Intel® GPU drivers and setup environment for Inference application…
  ☆20Updated 2 months ago
• intel / xetla
  ☆62Updated 11 months ago
• openvinotoolkit / openvino_contrib
  Repository for OpenVINO's extra modules
  ☆150Updated 2 weeks ago