🤗 Optimum Intel: Accelerate inference with Intel optimization tools
☆549Mar 16, 2026Updated last week
Alternatives and similar repositories for optimum-intel
Users that are interested in optimum-intel are comparing it to the libraries listed below
Sorting:
- Run Generative AI models with simple C++/Python API and using OpenVINO Runtime☆465Mar 16, 2026Updated last week
- OpenVINO Tokenizers extension☆49Updated this week
- A curated list of OpenVINO based AI projects☆188Jun 30, 2025Updated 8 months ago
- Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)☆207Mar 16, 2026Updated last week
- A Python package for extending the official PyTorch that can easily obtain performance on Intel platform☆2,014Mar 13, 2026Updated last week
- 🚀 Accelerate inference and training of 🤗 Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization…☆3,332Mar 13, 2026Updated last week
- 📚 Jupyter notebook tutorials for OpenVINO™☆3,066Updated this week
- Tools for easier OpenVINO development/debugging☆10Jul 16, 2025Updated 8 months ago
- Large Language Model Text Generation Inference on Habana Gaudi☆34Mar 20, 2025Updated last year
- Neural Network Compression Framework for enhanced OpenVINO™ inference☆1,141Updated this week
- With OpenVINO Test Drive, users can run large language models (LLMs) and models trained by Intel Geti on their devices, including AI PCs …☆37Mar 12, 2026Updated last week
- SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, …☆2,598Updated this week
- OpenVINO™ is an open source toolkit for optimizing and deploying AI inference☆9,917Updated this week
- ⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Pl…☆2,178Oct 8, 2024Updated last year
- OpenVINO Intel NPU Compiler☆84Updated this week
- An innovative library for efficient LLM inference via low-bit quantization☆352Aug 30, 2024Updated last year
- 🎯An accuracy-first, highly efficient quantization toolkit for LLMs, designed to minimize quality degradation across Weight-Only Quantiza…☆914Updated this week
- Intel® NPU (Neural Processing Unit) Driver☆390Mar 12, 2026Updated last week
- GenAI components at micro-service level; GenAI service composer to create mega-service☆195Updated this week
- A scalable inference server for models optimized with OpenVINO™☆839Updated this week
- ☆20Nov 27, 2025Updated 3 months ago
- Edge Insights for Vision (eiv) is a package that helps to auto install Intel® GPU drivers and setup environment for Inference application…☆21Sep 29, 2025Updated 5 months ago
- Reference models for Intel(R) Gaudi(R) AI Accelerator☆170Jan 8, 2026Updated 2 months ago
- Blazing fast training of 🤗 Transformers on Graphcore IPUs☆87Mar 11, 2024Updated 2 years ago
- Intel® AI Reference Models: contains Intel optimizations for running deep learning workloads on Intel® Xeon® Scalable processors and Inte…☆730Feb 11, 2026Updated last month
- Software Development Kit (SDK) for the Geti™ platform for Computer Vision AI model training.☆124Updated this week
- Intel® Extension for DeepSpeed* is an extension to DeepSpeed that brings feature support with SYCL kernels on Intel GPU(XPU) device. Note…☆65Jun 30, 2025Updated 8 months ago
- Repository for OpenVINO's extra modules☆170Updated this week
- oneCCL Bindings for Pytorch* (deprecated)☆104Dec 31, 2025Updated 2 months ago
- Intel® NPU Acceleration Library☆709Apr 24, 2025Updated 10 months ago
- AI PC starter app for doing AI image creation, image stylizing, and chatbot on a PC powered by an Intel® Arc™ GPU.☆780Mar 12, 2026Updated last week
- 🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of O…☆333Sep 25, 2025Updated 5 months ago
- ☆1,537Sep 29, 2023Updated 2 years ago
- **ARCHIVED** Filesystem interface to 🤗 Hub☆59Apr 6, 2023Updated 2 years ago
- A pytorch quantization backend for optimum☆1,032Nov 21, 2025Updated 4 months ago
- Evaluation, benchmark, and scorecard, targeting for performance on throughput and latency, accuracy on popular evaluation harness, safety…☆40Jan 5, 2026Updated 2 months ago
- An Awesome list of oneAPI projects☆158Aug 8, 2025Updated 7 months ago
- Prune a model while finetuning or training.☆406Jun 21, 2022Updated 3 years ago
- Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V,…☆8,732Jan 28, 2026Updated last month