🤗 Optimum Intel: Accelerate inference with Intel optimization tools
☆561Apr 2, 2026Updated last week
Alternatives and similar repositories for optimum-intel
Users that are interested in optimum-intel are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Run Generative AI models with simple C++/Python API and using OpenVINO Runtime☆481Updated this week
- OpenVINO Tokenizers extension☆50Apr 2, 2026Updated last week
- Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)☆208Apr 3, 2026Updated last week
- A curated list of OpenVINO based AI projects☆191Jun 30, 2025Updated 9 months ago
- A Python package for extending the official PyTorch that can easily obtain performance on Intel platform☆2,010Mar 30, 2026Updated last week
- DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- 🚀 Accelerate inference and training of 🤗 Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization…☆3,354Apr 2, 2026Updated last week
- 📚 Jupyter notebook tutorials for OpenVINO™☆3,088Apr 2, 2026Updated last week
- Tools for easier OpenVINO development/debugging☆10Jul 16, 2025Updated 8 months ago
- Large Language Model Text Generation Inference on Habana Gaudi☆34Mar 20, 2025Updated last year
- Neural Network Compression Framework for enhanced OpenVINO™ inference☆1,146Apr 3, 2026Updated last week
- With OpenVINO Test Drive, users can run large language models (LLMs) and models trained by Intel Geti on their devices, including AI PCs …☆37Mar 12, 2026Updated last month
- SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, …☆2,612Updated this week
- OpenVINO™ is an open source toolkit for optimizing and deploying AI inference☆10,054Updated this week
- ⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Pl…☆2,178Oct 8, 2024Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- OpenVINO Intel NPU Compiler☆86Updated this week
- An innovative library for efficient LLM inference via low-bit quantization☆351Aug 30, 2024Updated last year
- SOTA rounding-based quantization for high-accuracy low-bit LLM inference, seamlessly optimized for CPU/XPU/CUDA, with multi-datatype supp…☆957Updated this week
- Intel® NPU (Neural Processing Unit) Driver☆402Apr 3, 2026Updated last week
- GenAI components at micro-service level; GenAI service composer to create mega-service☆195Updated this week
- A scalable inference server for models optimized with OpenVINO™☆852Apr 3, 2026Updated last week
- ☆20Nov 27, 2025Updated 4 months ago
- Edge Insights for Vision (eiv) is a package that helps to auto install Intel® GPU drivers and setup environment for Inference application…☆21Sep 29, 2025Updated 6 months ago
- Reference models for Intel(R) Gaudi(R) AI Accelerator☆171Jan 8, 2026Updated 3 months ago
- DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Blazing fast training of 🤗 Transformers on Graphcore IPUs☆87Apr 3, 2026Updated last week
- Intel® AI Reference Models: contains Intel optimizations for running deep learning workloads on Intel® Xeon® Scalable processors and Inte…☆731Feb 11, 2026Updated 2 months ago
- Software Development Kit (SDK) for the Geti™ platform for Computer Vision AI model training.☆122Updated this week
- Intel® Extension for DeepSpeed* is an extension to DeepSpeed that brings feature support with SYCL kernels on Intel GPU(XPU) device. Note…☆65Jun 30, 2025Updated 9 months ago
- Repository for OpenVINO's extra modules☆171Updated this week
- oneCCL Bindings for Pytorch* (deprecated)☆104Dec 31, 2025Updated 3 months ago
- Intel® NPU Acceleration Library☆709Apr 24, 2025Updated 11 months ago
- AI PC starter app for doing AI image creation, image stylizing, and chatbot on a PC powered by an Intel® Arc™ GPU.☆823Updated this week
- 🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of O…☆334Apr 3, 2026Updated last week
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆1,536Sep 29, 2023Updated 2 years ago
- **ARCHIVED** Filesystem interface to 🤗 Hub☆59Apr 6, 2023Updated 3 years ago
- A pytorch quantization backend for optimum☆1,035Apr 2, 2026Updated last week
- Prune a model while finetuning or training.☆406Jun 21, 2022Updated 3 years ago
- An Awesome list of oneAPI projects☆162Aug 8, 2025Updated 8 months ago
- Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V,…☆8,752Jan 28, 2026Updated 2 months ago
- Efficient few-shot learning with Sentence Transformers☆2,710Apr 2, 2026Updated last week