🤗 Optimum ONNX: Export your model to ONNX and run inference with ONNX Runtime
☆159Jul 21, 2026Updated last month
Alternatives and similar repositories for optimum-onnx
Users that are interested in optimum-onnx are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 🤗 Optimum ExecuTorch☆141Updated this week
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆32Sep 19, 2025Updated last year
- 🤗 Tokenizers.js: A pure JS/TS implementation of today's most used tokenizers☆57Updated this week
- Use safetensors with ONNX 🤗☆90Aug 4, 2026Updated last month
- 👷 Build compute kernels☆213Apr 6, 2026Updated 5 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- 🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of O…☆341Updated this week
- Large Language Model Onnx Inference Framework☆35Nov 25, 2025Updated 9 months ago
- Knowledgeable Embedding: Injecting dynamically updatable entity knowledge into embeddings to enhance RAG☆15Aug 31, 2025Updated last year
- A Toolkit to Help Optimize Onnx Model☆518Sep 7, 2026Updated last week
- Generative AI extensions for onnxruntime☆1,124Updated this week
- The backend behind the LLM-Perf Leaderboard☆11May 5, 2024Updated 2 years ago
- Tutorial on how to convert machine learned models into ONNX☆14Mar 11, 2023Updated 3 years ago
- Mount Hugging Face Buckets and repos as local filesystems. No download, no copy, no waiting.☆803Updated this week
- Smart commit messages☆18Oct 25, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆126Dec 15, 2023Updated 2 years ago
- A curated list for Efficient Large Language Models☆11Mar 25, 2024Updated 2 years ago
- Efficient in-memory representation for ONNX, in Python☆46Updated this week
- 🚂 Fine-tune OpenAI models for text classification, question answering, and more☆17May 1, 2023Updated 3 years ago
- Google TPU optimizations for transformers models☆136Jan 23, 2026Updated 7 months ago
- A DDR3 Controller that uses the Xilinx MIG-7 PHY to interface with DDR3 devices.☆12Aug 22, 2021Updated 5 years ago
- Benchmark tests supporting the TiledCUDA library.☆19Nov 19, 2024Updated last year
- Common utilities for ONNX converters☆304Sep 1, 2026Updated 2 weeks ago
- ☆82May 14, 2026Updated 4 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- mnn tts demo.☆20May 7, 2025Updated last year
- A lightweight, single-header C++11 Jinja2 template engine for LLM chat templates.☆20Mar 4, 2026Updated 6 months ago
- Build compute kernels and load them from the Hub.☆745Updated this week
- A pytorch quantization backend for optimum☆1,053Aug 25, 2026Updated 3 weeks ago
- Multiple GEMM operators are constructed with cutlass to support LLM inference.☆20Aug 3, 2025Updated last year
- ☆11Nov 16, 2024Updated last year
- Components that I have created for Kubeflow Pipelines. Try them in https://cloud-pipelines.net/pipeline-editor/☆16Dec 1, 2025Updated 9 months ago
- Implementation of the dilated self attention as described in "LongNet: Scaling Transformers to 1,000,000,000 Tokens"☆13Jul 23, 2023Updated 3 years ago
- Gradio Client in Rust.☆31Sep 8, 2026Updated last week
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- onnxruntime-extensions: A specialized pre- and post- processing library for ONNX Runtime☆478Updated this week
- mnn asr demo.☆27Mar 24, 2025Updated last year
- A RAG that can scale 🧑🏻💻☆11May 28, 2024Updated 2 years ago
- Awesome code, projects, books, etc. related to CUDA☆43Aug 9, 2026Updated last month
- Cookbook of SGLang - Recipe☆10May 5, 2026Updated 4 months ago
- Qwen-Image's DiT inference with TensorRT-10☆21Oct 13, 2025Updated 11 months ago
- tsingmicro AI model zoo☆13Aug 6, 2025Updated last year