A Demo server serving Bert through ONNX with GPU written in Rust with <3
☆42Jul 30, 2021Updated 5 years ago
Alternatives and similar repositories for bert-onnx-rs-server
Users that are interested in bert-onnx-rs-server are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This demo showcase the use of onnxruntime-rs with a GPU on CUDA 11 to run Bert in a data pipeline with Rust.☆16Feb 7, 2022Updated 4 years ago
- Rust wrapper for Microsoft's ONNX Runtime with CUDA support (version 1.7)☆24Jul 3, 2022Updated 4 years ago
- Rust wrapper for Microsoft's ONNX Runtime (version 1.8)☆331Mar 6, 2024Updated 2 years ago
- This repository hosts the code to port NumPy model weights of BiT-ResNets to TensorFlow SavedModel format.☆14Dec 21, 2021Updated 4 years ago
- ☆13Aug 29, 2022Updated 4 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- 🦀 Example of serving deep learning models in Rust with batched prediction☆34Mar 9, 2023Updated 3 years ago
- An example of using Torch rust bindings to serve trained machine learning models via Actix Web☆17Aug 15, 2021Updated 5 years ago
- Tensorflow Layers provides Rust implementations of Tensorflow model layers☆17Jan 22, 2026Updated 8 months ago
- ☆20Nov 23, 2022Updated 3 years ago
- Learn Rust on AWS or Learn AWS with Rust. Do whatever you would like.☆28Sep 2, 2021Updated 5 years ago
- Rust wrappers for NGT approximate nearest neighbor search☆39May 18, 2024Updated 2 years ago
- A TUI based chat room service with basic core chat functionalities, including JWT authentication, message persistence and live updates☆17Sep 6, 2025Updated last year
- A rust interface to http://openml.org/☆12Jul 13, 2019Updated 7 years ago
- Automated Machine Learning in Rust 🦀☆39Sep 20, 2026Updated 3 weeks ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- m3 techbook templete☆11May 2, 2023Updated 3 years ago
- Avrow is a pure Rust implementation of the avro specification https://avro.apache.org/docs/current/spec.html with Serde support.☆29Nov 5, 2022Updated 3 years ago
- ☆13Jun 4, 2021Updated 5 years ago
- Dependency and environment manager for Python projects☆13Jun 6, 2022Updated 4 years ago
- A queue designed for buffer swapping instead of task popping☆24Sep 25, 2022Updated 4 years ago
- ☆12Sep 8, 2022Updated 4 years ago
- powerline theme for xonsh with async prompt support.☆13Dec 25, 2024Updated last year
- Highly concurrent and fast content processing for Mighty Inference Server☆10Feb 6, 2023Updated 3 years ago
- Example of Rust API for Machine Learning☆19Sep 11, 2021Updated 5 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Bandit Algorithms in Rust☆35Feb 28, 2025Updated last year
- Messing around with deep learning☆11Aug 29, 2021Updated 5 years ago
- An openAI CLI built in rust☆10Dec 28, 2022Updated 3 years ago
- Static Linear Algebra System☆35Aug 14, 2023Updated 3 years ago
- Const FNV1A hashing implementation.☆20Aug 13, 2022Updated 4 years ago
- AllenNLP integration for Shiba: Japanese CANINE model☆12Jun 26, 2021Updated 5 years ago
- A HDPSG-inspired symbolic natural language parser written in Rust☆62Mar 11, 2025Updated last year
- A CLI in Rust to generate synthetic data for MLX friendly training☆25Jan 13, 2024Updated 2 years ago
- Rust crate for some audio utilities☆32Jun 17, 2026Updated 4 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- A flask microservice for generating random fruit!☆10Mar 19, 2022Updated 4 years ago
- Rust library of fast and compact string dictionary using Front-Coding☆12Updated this week
- Neural syntax annotator, supporting sequence labeling, lemmatization, and dependency parsing.☆81Oct 22, 2023Updated 2 years ago
- A Rust🦀 implementation of CRAFTML, an Efficient Clustering-based Random Forest for Extreme Multi-label Learning☆15Mar 19, 2019Updated 7 years ago
- gpwho? GPU usage logger, with Telegram bot integration.☆14Sep 21, 2020Updated 6 years ago
- Rust port of the extended isolation forest algorithm for anomaly detection☆18Apr 26, 2023Updated 3 years ago
- Open source TUI for downloading mp3's from various sources☆21Feb 27, 2026Updated 7 months ago