huggingface / optimum-onnxLinks
π€ Optimum ONNX: Export your model to ONNX and run inference with ONNX Runtime
β83Updated last week
Alternatives and similar repositories for optimum-onnx
Users that are interested in optimum-onnx are comparing it to the libraries listed below
Sorting:
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.β33Updated 2 months ago
- Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.β88Updated this week
- π€ Trade any tensors over the networkβ30Updated 2 years ago
- π· Build compute kernelsβ178Updated this week
- Rust crate for some audio utilitiesβ25Updated 8 months ago
- Use safetensors with ONNX π€β73Updated last month
- FRP Forkβ176Updated 7 months ago
- πΉοΈ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.β139Updated last year
- β86Updated 4 months ago
- A small rust-based data loaderβ31Updated 5 months ago
- Proof of concept for running moshi/hibiki using webrtcβ19Updated 8 months ago
- vLLM adapter for a TGIS-compatible gRPC server.β44Updated this week
- Google TPU optimizations for transformers modelsβ122Updated 9 months ago
- β43Updated last month
- Pixel Parsing. A reproduction of OCR-free end-to-end document understanding models with open dataβ21Updated last year
- python bindings for symphonia/opus - read various audio formats from python and write opus filesβ70Updated 3 months ago
- QLoRA with Enhanced Multi GPU Supportβ37Updated 2 years ago
- Optimus is a flexible and scalable framework built to train language models efficiently across diverse hardware configurations, includingβ¦β67Updated 4 months ago
- β92Updated 5 months ago
- Thin wrapper around GGML to make life easierβ40Updated 2 weeks ago
- Lightweight toolkit package to train and fine-tune 1.58bit Language modelsβ98Updated 6 months ago
- **ARCHIVED** Filesystem interface to π€ Hubβ58Updated 2 years ago
- Datamodels for hugging face tokenizersβ86Updated 2 weeks ago
- A fast RWKV Tokenizer written in Rustβ54Updated 3 months ago
- Hugging Face Jobsβ19Updated 4 months ago
- β59Updated last year
- Simple high-throughput inference libraryβ149Updated 6 months ago
- β25Updated 11 months ago
- The backend behind the LLM-Perf Leaderboardβ11Updated last year
- Python bindings for ggmlβ146Updated last year