xtuc / triton-rsLinks
Rust bindings to the Triton Inference Server
☆15Updated last year
Alternatives and similar repositories for triton-rs
Users that are interested in triton-rs are comparing it to the libraries listed below
Sorting:
- Example kubernetes reflector and web server with axum☆52Updated last week
- A client library in Rust for Nvidia Triton.☆30Updated last year
- Fast serverless LLM inference, in Rust.☆89Updated 4 months ago
- Tantivy directory implementation backed by object_store☆33Updated last year
- Extract core logic from qdrant and make it available as a library.☆60Updated last year
- A workflow scheduler based on petri-nets☆81Updated this week
- A suite of data generation and load testing tools☆87Updated this week
- A collection of crates to make implementing Kubernetes operators easier☆145Updated last week
- Comparing performance-oriented string-processing libraries for substring search, multi-pattern matching, hashing, and Levenshtein edit-di…☆46Updated 4 months ago
- Rust FFI example binding for chDB, an embedded SQL Engine powered by ClickHouse☆36Updated 3 months ago
- Data pipeline example written in Rust with Polars and DataFusion DataFrame package☆41Updated 2 years ago
- Rust-tokenizer offers high-performance tokenizers for modern language models, including WordPiece, Byte-Pair Encoding (BPE) and Unigram (…☆323Updated last year
- Back-end implementation of the Open Data Fabric protocol☆18Updated last week
- Rust crate for easy and efficient ML model inference☆25Updated 2 weeks ago
- A presto/trino client library written in rust.☆42Updated 7 months ago
- Andrej Karpathy's Let's build GPT: from scratch video & notebook implemented in Rust + candle☆73Updated last year
- Rust DataFusion Server☆19Updated last week
- Rust port of sentence-transformers (https://github.com/UKPLab/sentence-transformers)☆117Updated 10 months ago
- Lightweight HTTP servers based on hyper / warp frameworks in the WasmEdge Runtime.☆89Updated last year
- Dataflow is a data processing library, primarily for machine learning.☆24Updated 2 years ago
- Example of tch-rs on M1☆54Updated last year
- Rust bindings for OpenNMT/CTranslate2☆33Updated 3 months ago
- ☆22Updated 3 years ago
- Rust client for the huggingface hub aiming for minimal subset of features over `huggingface-hub` python package☆217Updated last month
- 🦀Rust + Large Language Models - Make AI Services Freely and Easily.☆183Updated last year
- Rust PostgreSQL database performance insights. Locks, index usage, buffer cache hit ratios, vacuum stats and more.☆63Updated 7 months ago
- OpenSearch Rust Client☆83Updated last week
- A highly customable, adaptable, runtime agnostic and WASM/WASI friendly Gossip protocol (SWIM) which helps manage cluster membership and …☆116Updated 2 weeks ago
- a rust port of kafkacat☆30Updated last year
- Rust wrapper for Microsoft's ONNX Runtime (version 1.8)☆302Updated last year