A Demo server serving Bert through ONNX with GPU written in Rust with <3
☆42Jul 30, 2021Updated 5 years ago
Alternatives and similar repositories for bert-onnx-rs-server
Users that are interested in bert-onnx-rs-server are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- This demo showcase the use of onnxruntime-rs with a GPU on CUDA 11 to run Bert in a data pipeline with Rust.☆16Feb 7, 2022Updated 4 years ago
- Rust wrapper for Microsoft's ONNX Runtime with CUDA support (version 1.7)☆24Jul 3, 2022Updated 4 years ago
- Rust wrapper for Microsoft's ONNX Runtime (version 1.8)☆329Mar 6, 2024Updated 2 years ago
- This repository hosts the code to port NumPy model weights of BiT-ResNets to TensorFlow SavedModel format.☆14Dec 21, 2021Updated 4 years ago
- 🦀 Example of serving deep learning models in Rust with batched prediction☆34Mar 9, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- An example of using Torch rust bindings to serve trained machine learning models via Actix Web☆17Aug 15, 2021Updated 5 years ago
- Tensorflow Layers provides Rust implementations of Tensorflow model layers☆17Jan 22, 2026Updated 6 months ago
- Rust wrappers for NGT approximate nearest neighbor search☆40May 18, 2024Updated 2 years ago
- A TUI based chat room service with basic core chat functionalities, including JWT authentication, message persistence and live updates☆17Sep 6, 2025Updated 11 months ago
- ☆11Aug 14, 2018Updated 8 years ago
- This repositary hosts my experiments for the project, I did with OffNote Labs.☆10Apr 12, 2021Updated 5 years ago
- A queue designed for buffer swapping instead of task popping☆23Sep 25, 2022Updated 3 years ago
- m3 techbook templete☆11May 2, 2023Updated 3 years ago
- Rust server that summarizes text with pre-trained models☆18Mar 8, 2023Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Avrow is a pure Rust implementation of the avro specification https://avro.apache.org/docs/current/spec.html with Serde support.☆29Nov 5, 2022Updated 3 years ago
- Process, visualize and use data easily.☆20Jul 6, 2023Updated 3 years ago
- Dependency and environment manager for Python projects☆13Jun 6, 2022Updated 4 years ago
- ☆12Sep 8, 2022Updated 3 years ago
- A machine learning library for Rust.☆334Aug 19, 2024Updated 2 years ago
- ☆14Dec 8, 2025Updated 8 months ago
- Bandit Algorithms in Rust☆35Feb 28, 2025Updated last year
- Use common pre-trained ML models in Deno!☆19Nov 21, 2021Updated 4 years ago
- Static Linear Algebra System☆36Aug 14, 2023Updated 3 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Reinforcement learning with Rust☆14Jul 31, 2022Updated 4 years ago
- Example of Rust API for Machine Learning☆19Sep 11, 2021Updated 4 years ago
- A HDPSG-inspired symbolic natural language parser written in Rust☆62Mar 11, 2025Updated last year
- Const FNV1A hashing implementation.☆20Aug 13, 2022Updated 4 years ago
- An openAI CLI built in rust☆10Dec 28, 2022Updated 3 years ago
- Rust library of fast and compact string dictionary using Front-Coding☆12Mar 27, 2022Updated 4 years ago
- Use deep learning to have a conversation with anyone — fictional, famous, or historical.☆14Apr 2, 2021Updated 5 years ago
- Neural syntax annotator, supporting sequence labeling, lemmatization, and dependency parsing.☆81Oct 22, 2023Updated 2 years ago
- Rust crate for some audio utilities☆32Jun 17, 2026Updated 2 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Rust PyTorch GPU configuration☆53Sep 5, 2023Updated 2 years ago
- Open source TUI for downloading mp3's from various sources☆21Feb 27, 2026Updated 5 months ago
- Example of Apolle Codegen with TypeScript and React☆14Dec 18, 2018Updated 7 years ago
- Evaluation metrics for machine learning☆15Jan 14, 2026Updated 7 months ago
- 刷题学习rust☆15Jun 6, 2022Updated 4 years ago
- 使用 PaddlePaddle 实现基于深度神经网络的中文分词引擎 | A DNN Chinese Tokenizer by Using PaddlePaddle☆14Jul 27, 2020Updated 6 years ago
- Python package for rematerialization-aware gradient checkpointing☆27Oct 31, 2023Updated 2 years ago