π Accelerate inference and training of π€ Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization tools
β3,525Nov 16, 2026Updated this week
Alternatives and similar repositories for optimum
Users that are interested in optimum are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- π A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (iβ¦β9,950Updated this week
- π€ Evaluate: A library for easily evaluating machine learning models and datasets.β2,498Updated this week
- π€ PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.β21,909Updated this week
- Large Language Model Text Generation Inferenceβ10,876Mar 21, 2026Updated 7 months ago
- Accessible large language models via k-bit quantization for PyTorch.β8,547Nov 2, 2026Updated 2 weeks ago
- End-to-end encrypted email - Proton Mail β’ AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- π€ The largest hub of ready-to-use datasets for AI models with fast, easy-to-use and efficient data manipulation toolsβ22,173Updated this week
- Efficient, scalable and enterprise-grade CPU/GPU inference server for π€ Hugging Face transformer models πβ1,693Oct 23, 2024Updated 2 years ago
- π₯ Fast State-of-the-Art Tokenizers optimized for Research and Productionβ11,262Updated this week
- π€ Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch.β34,959Updated this week
- Transformer related optimization, including BERT, GPTβ6,458Mar 27, 2024Updated 2 years ago
- Hackable and optimized Transformers building blocks, supporting a composable construction.β10,578Nov 13, 2026Updated last week
- Fast and memory-efficient exact attentionβ25,326Updated this week
- Simple, safe way to store and distribute tensorsβ3,968Updated this week
- Train transformer language models with reinforcement learning.β19,779Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer β’ AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A pytorch quantization backend for optimumβ1,056Updated this week
- MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.β2,118Jun 30, 2025Updated last year
- π€ Optimum Intel: Accelerate inference with Intel optimization toolsβ631Updated this week
- DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.β43,347Updated this week
- SOTA low-bit LLM quantization (INT8/FP8/MXFP8/INT4/MXFP4/NVFP4) & sparsity; leading model compression techniques on PyTorch, TensorFlow, β¦β2,732Updated this week
- Efficient few-shot learning with Sentence Transformersβ2,868Updated this week
- TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizatβ¦β15,108Updated this week
- The Triton Inference Server provides an optimized cloud and edge inferencing solution.β11,156Updated this week
- An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.β5,067Apr 11, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways β’ AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- PyTorch native quantization for training and inferenceβ3,029Updated this week
- State-of-the-Art Embeddings, Retrieval, and Rerankingβ19,294Updated this week
- Development repository for the Triton language and compilerβ20,604Updated this week
- PyTorch extensions for high performance and large scale training.β3,404Apr 26, 2025Updated last year
- Fast inference engine for Transformer modelsβ4,758Updated this week
- Supercharge Your Model Trainingβ5,503Apr 29, 2026Updated 6 months ago
- A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit and 4-bit floating point (FP8 and FP4) precision on Hβ¦β3,609Updated this week
- β1,039Sep 24, 2026Updated last month
- A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Autoβ¦β18,770Updated this week
- Managed hosting for WordPress and PHP on Cloudways β’ AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A blazing fast inference solution for text embeddings modelsβ5,128Updated this week
- Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalitiesβ22,248Sep 21, 2026Updated 2 months ago
- ποΈ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of Oβ¦β341Nov 10, 2026Updated last week
- A high-throughput and memory-efficient inference and serving engine for LLMsβ97,265Updated this week
- π€ Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal modelβ¦β169,320Updated this week
- Tensor library for machine learningβ16,130Updated this week
- Ongoing research training transformer models at scaleβ18,445Updated this week
Are these results useful?