🤗 Optimum ONNX: Export your model to ONNX and run inference with ONNX Runtime
☆163Oct 6, 2026Updated last month
Alternatives and similar repositories for optimum-onnx
Users that are interested in optimum-onnx are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 🚀 Accelerate inference and training of 🤗 Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization…☆3,526Updated this week
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆32Sep 19, 2025Updated last year
- Build generative models in ONNX☆23Updated this week
- Use safetensors with ONNX 🤗☆91Aug 4, 2026Updated 3 months ago
- 🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of O…☆342Nov 10, 2026Updated last week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- 👷 Build compute kernels☆213Apr 6, 2026Updated 7 months ago
- Fast BM25 search engine with category theory abstractions☆12Feb 22, 2026Updated 8 months ago
- Notes and artifacts from the ONNX steering committee☆29Oct 21, 2026Updated 3 weeks ago
- Large Language Model Onnx Inference Framework☆35Nov 25, 2025Updated 11 months ago
- A Toolkit to Help Optimize Onnx Model☆526Nov 4, 2026Updated 2 weeks ago
- a repo to study TensorRT Plugin☆11Apr 30, 2025Updated last year
- ☆19Feb 23, 2026Updated 8 months ago
- A pytorch quantization backend for optimum☆1,056Updated this week
- Mount Hugging Face Buckets and repos as local filesystems. No download, no copy, no waiting.☆827Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- SGLang wheels for multiple platforms☆11Oct 13, 2025Updated last year
- ☆126Dec 15, 2023Updated 2 years ago
- A curated list for Efficient Large Language Models☆11Mar 25, 2024Updated 2 years ago
- Training and inference on AWS Trainium and Inferentia chips.☆271Updated this week
- Efficient in-memory representation for ONNX, in Python☆54Updated this week
- A lightweight, single-header C++11 Jinja2 template engine for LLM chat templates.☆20Mar 4, 2026Updated 8 months ago
- A Deeplearn Model to rec table in photo with ncnn. 一个深度学习模型用于检测图片中的表格 画像内のテーブルを検出するためのディープラーニング モデル☆20Mar 2, 2025Updated last year
- GPU Kernel Manager Operator☆12Nov 9, 2026Updated last week
- Browse, search, and visualize ONNX models.☆36May 6, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Google TPU optimizations for transformers models☆137Jan 23, 2026Updated 9 months ago
- A DDR3 Controller that uses the Xilinx MIG-7 PHY to interface with DDR3 devices.☆12Aug 22, 2021Updated 5 years ago
- ☆12Jul 14, 2026Updated 4 months ago
- An Alice chatbot fallback for Mycroft (all hail JarbasAI who did most of the work)☆12Aug 3, 2022Updated 4 years ago
- official repo for RIGOR: Rig-Informed Geometry for Omnidirectional Reconstruction☆22Oct 9, 2026Updated last month
- Just Infer It.☆10Feb 23, 2024Updated 2 years ago
- Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.☆98Oct 5, 2026Updated last month
- Systemd service files for the Mycroft A.I. software stack☆10Sep 10, 2026Updated 2 months ago
- AMD related optimizations for transformer models☆102Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Build compute kernels and load them from the Hub.☆790Updated this week
- 🌏 Modular retrievers for zero-shot multilingual IR.☆29Mar 6, 2024Updated 2 years ago
- Implementation of the dilated self attention as described in "LongNet: Scaling Transformers to 1,000,000,000 Tokens"☆13Jul 23, 2023Updated 3 years ago
- PyTorch native quantization for training and inference☆3,030Updated this week
- My implementation of the RTMDet object detector☆14Oct 4, 2025Updated last year
- Universal cross-platform tokenizers binding to HF and sentencepiece☆514May 20, 2026Updated 5 months ago
- Stera Capture: a mobile-phone-native stack for collecting high-fidelity multimodal RGB-D data.☆17Jul 28, 2026Updated 3 months ago
Are these results useful?