3xMike / tritonserver-rs
Rust crate for easy and efficient ML model inference
☆17Updated last month
Alternatives and similar repositories for tritonserver-rs:
Users that are interested in tritonserver-rs are comparing it to the libraries listed below
- ☆23Updated 2 years ago
- BUS/RT - Modern, fast, Rust-native IPC broker☆119Updated 3 weeks ago
- An asynchronous Redis client for Rust☆93Updated last week
- ☆52Updated 3 weeks ago
- This Rust-based tool generates, compiles, and tests code using LLMs, resolves dependencies, and provides explanations of existing code th…☆65Updated 3 months ago
- Models and examples built with Burn☆213Updated 3 weeks ago
- ☆120Updated 7 months ago
- Llama2 LLM ported to Rust burn☆277Updated 10 months ago
- Rust allocator using jemalloc as a backend☆389Updated 2 weeks ago
- ☆25Updated 3 years ago
- Gabriel2: Indeed, an actor library based on Tokio, written in Rust☆27Updated 7 months ago
- Rust client for Qdrant vector search engine☆257Updated 3 weeks ago
- Rust ZeroMQ bindings for Tokio☆153Updated 4 months ago
- Rust client for the huggingface hub aiming for minimal subset of features over `huggingface-hub` python package☆181Updated this week
- Official pure Rust typed client for ClickHouse DB☆354Updated this week
- Metatron library: Implementation in Rust of a report generation☆61Updated 5 months ago
- Asynchronous Programming in Rust☆32Updated 2 months ago
- A machine learning library for Rust.☆324Updated 6 months ago
- Extra Tower middlewares and utilities for HTTP clients.☆10Updated 4 months ago
- Shiva library: Implementation in Rust of a parser and generator for documents of any type☆335Updated 3 months ago
- Low rank adaptation (LoRA) for Candle.☆142Updated 6 months ago
- High-level async Cassandra client written in 100% Rust.☆141Updated this week
- A binary encoder/decoder for Rust☆416Updated this week
- Asynchronous event dispatch for Rust☆162Updated 3 months ago
- Fantastic serialization library☆159Updated 9 months ago
- Run Generative AI models directly on your hardware☆29Updated 6 months ago
- A simple Cross-platform thread schedule and priority library for rust.☆119Updated 3 months ago
- Async middleware and interceptor for Tonic gRPC services☆57Updated 2 weeks ago
- Plotlars is a Rust library designed to facilitate the integration between the Polars data analysis library and Plotly library.☆393Updated last month
- Safe and fast minimalistic web server, written in Rust, that serves files from a directory and proxies requests to another server.☆61Updated last month