Inference service built in Rust for deploying Large Language Models
☆56Jan 22, 2025Updated last year
Alternatives and similar repositories for rust-inference-service
Users that are interested in rust-inference-service are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- High-performance and concurrent string interning for general purpose use.☆12Jun 6, 2026Updated 5 months ago
- Public helper libraries and utilities for poststation☆14Feb 11, 2025Updated last year
- A crate for connecting to and communicating with a Raspberry Pi microcontroller in BOOTSEL mode over USB.☆10Jun 12, 2025Updated last year
- Give agents access to virtual hardware.☆18Updated this week
- Code for Apache Hudi, Apache Iceberg and Delta Lake analysis☆10Feb 2, 2024Updated 2 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- cdc-ncm http server implmented on stamdev☆10Feb 3, 2025Updated last year
- an optimizing compiler to a binary turing machine☆14Dec 16, 2024Updated last year
- Cloud file and email Sync, file Sharing, inter-cloud Encryption and Backup solution written in Rust and modern technologies☆15Updated this week
- static blog engine - blog page☆10Dec 24, 2020Updated 5 years ago
- Cycle-level, trace-driven, parallel GPU simulator for NVIDIA Pascal.☆15Dec 13, 2025Updated 11 months ago
- In-memory vector database in Rust☆23Dec 23, 2024Updated last year
- A little KV store implementation in OCaml to practice DB systems things☆33Jan 21, 2026Updated 9 months ago
- Authenticate the cryptographic chain-of-custody of Linux distributions (like Arch Linux and Debian) to their source code inputs☆28Apr 18, 2025Updated last year
- An eBPF engine for capturing and processing POSIX signals.☆42May 9, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Torrent (transmission-remote API) TUI (Ratatui) in Rust☆15Sep 12, 2026Updated 2 months ago
- A TUI for managing rust projects☆11Nov 10, 2026Updated last week
- Visualize chess boards in your terminal!☆11Oct 8, 2026Updated last month
- RPC / IPC over SHM, for Rust - good for plugins and such☆74Jan 19, 2026Updated 9 months ago
- ☆30Dec 31, 2025Updated 10 months ago
- High-performance async Rust logging library with non-blocking writers and bindings for C, C++, C#, Go, Java and Python☆43Oct 5, 2026Updated last month
- WebAssembly AST Parser☆48Oct 13, 2015Updated 11 years ago
- Cross-platform named-pipe library for Rust☆32Sep 13, 2024Updated 2 years ago
- A local network discovery tool written in Rust☆14Jun 1, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A simple, vim-inspired terminal text editor built with Rust.☆10Sep 24, 2025Updated last year
- cargo plugin to run commands against all combinations of features☆14Nov 10, 2026Updated last week
- Learn x86 assembly through interactive exercises.☆35Jul 22, 2026Updated 3 months ago
- Observe memory, cpu, and disk I/O for processes matching the provided name.☆12Dec 25, 2025Updated 10 months ago
- 🐊 A pure zig implementation of TFHE Fully Homomorphic Encryption Scheme☆41Nov 3, 2025Updated last year
- ☆39Jul 9, 2024Updated 2 years ago
- A zsh plugin for the Rust programming language toolchain.☆10Nov 1, 2026Updated 2 weeks ago
- Create Conventional Commit Messages with any LLM of your choice☆14Jul 27, 2026Updated 3 months ago
- grift is a no_std no_alloc no_unsafe lisp for bare-metal devices☆19Updated this week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- TrapFall — Lightweight self-hosted error capture engine. Sentry-compatible, Rust + SvelteKit 5.☆10Oct 26, 2026Updated 3 weeks ago
- a scripting language created in Rust~☆14Apr 16, 2026Updated 7 months ago
- Reclaim disk space from build artifacts. Rust TUI for cleaning target/, node_modules/, bin/, and obj/ across your workspace.☆16Aug 2, 2026Updated 3 months ago
- Rust examples in order to learn the language☆12Sep 15, 2015Updated 11 years ago
- A bounded single-producer, single-consumer and lock-free concurrent queue written in Zig, C++17☆33Apr 2, 2026Updated 7 months ago
- What if salsa but tokio-friendly☆52Jun 18, 2026Updated 5 months ago
- Host TUIs over SSH. No users. No passwords.☆15Updated this week
Are these results useful?