openvinotoolkit / openvino
OpenVINO™ is an open-source toolkit for optimizing and deploying AI inference
☆7,304Updated this week
Related projects ⓘ
Alternatives and complementary repositories for openvino
- Pre-trained Deep Learning models and demos (high quality and extremely fast)☆4,100Updated 2 weeks ago
- NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source compone…☆10,820Updated 2 weeks ago
- 📚 Jupyter notebook tutorials for OpenVINO™☆2,437Updated this week
- The Triton Inference Server provides an optimized cloud and edge inferencing solution.☆8,348Updated this week
- ONNX-TensorRT: TensorRT backend for ONNX☆2,953Updated 2 weeks ago
- ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator☆14,722Updated this week
- Open standard for machine learning interoperability☆17,949Updated this week
- PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT☆2,597Updated this week
- oneAPI Deep Neural Network Library (oneDNN)☆3,635Updated this week
- Development repository for the Triton language and compiler☆13,443Updated this week
- High-efficiency floating-point neural network inference operators for mobile, server, and Web☆1,885Updated this week
- Neural Network Compression Framework for enhanced OpenVINO™ inference☆943Updated this week
- Simplify your onnx model☆3,865Updated 2 months ago
- Serve, optimize and scale PyTorch models in production☆4,218Updated 3 weeks ago
- Open deep learning compiler stack for cpu, gpu and specialized accelerators☆11,798Updated this week
- A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep lear…☆5,158Updated this week
- A C++ standalone library for machine learning☆5,288Updated this week
- SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX R…☆2,227Updated this week
- A scalable inference server for models optimized with OpenVINO™☆675Updated this week
- Hello AI World guide to deploying deep-learning inference networks and deep vision primitives with TensorRT and NVIDIA Jetson.☆7,869Updated last month
- A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch☆8,415Updated 2 weeks ago
- Visualizer for neural network, deep learning and machine learning models☆28,167Updated this week
- An easy to use PyTorch to TensorRT converter☆4,612Updated 3 months ago
- State-of-the-Art Deep Learning scripts organized by models - easy to train and deploy with reproducible accuracy and performance on enter…☆13,580Updated 3 months ago
- Enabling PyTorch on XLA Devices (e.g. Google TPU)☆2,489Updated this week
- A Python package for extending the official PyTorch that can easily obtain performance on Intel platform☆1,624Updated this week
- Convert TensorFlow, Keras, Tensorflow.js and Tflite models to ONNX☆2,327Updated 2 months ago
- A collection of pre-trained, state-of-the-art models in the ONNX format☆7,974Updated 6 months ago
- A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Auto…☆12,150Updated this week
- Train, Evaluate, Optimize, Deploy Computer Vision Models via OpenVINO™☆1,143Updated this week