Inference service built in Rust for deploying Large Language Models
☆56Jan 22, 2025Updated last year
Alternatives and similar repositories for rust-inference-service
Users that are interested in rust-inference-service are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Rustybox is something like busybox, but written in Rust language.☆12Apr 15, 2014Updated 12 years ago
- A zsh plugin for the Rust programming language toolchain.☆10Sep 28, 2024Updated last year
- An Elixir wrapper around the Rust Lingua language detection library.☆16Apr 6, 2026Updated 4 months ago
- SIMD aligned data structures to work with `std::simd`.☆12Dec 14, 2024Updated last year
- A simple music-as-code library and synthesizer for rust☆16Mar 15, 2026Updated 5 months ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Package files in your executables with the Rust language☆14Oct 2, 2015Updated 10 years ago
- Protobuf Debugging Suite☆15Updated this week
- const fn implementation of the SHA-2 family of hash functions☆20Apr 2, 2026Updated 4 months ago
- A helper library to generate complex and nested structures by a simple macro☆14Updated this week
- A terminal Checkbox component designed for ratatui interoperability https://github.com/ratatui/ratatui☆17Updated this week
- Rust port of RatNet, an anonymity network designed for mesh routing and embedded scenarios.☆15Jul 29, 2025Updated last year
- libexecinfo for musl libc☆15Apr 16, 2022Updated 4 years ago
- Elm for ratatui — you bring the loop☆17Apr 23, 2026Updated 4 months ago
- PostCSS plugin that generates typed entities from CSS classes for chosen programming language.☆12Jan 7, 2023Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A Rust library for working with the HashiCorp Configuration Language (HCL).☆16Mar 12, 2018Updated 8 years ago
- Reactive Nix: Enabling Functional Reactive Configuration with mgmt☆15Feb 1, 2026Updated 6 months ago
- Interactive Rust project generator with intelligent templates and enterprise features. 7 project types including CLI, API server, WebAsse…☆16Updated this week
- [wip] ssh agent for bitwarden☆12Sep 9, 2024Updated last year
- Website for the Rust Audio org and Discord☆14Mar 17, 2026Updated 5 months ago
- A TUI based chat room service with basic core chat functionalities, including JWT authentication, message persistence and live updates☆17Sep 6, 2025Updated 11 months ago
- Minimal tmux popup/tabs radar for Codex, Amp, Claude Code, OpenCode, Pi, Antigravity, Kiro, Copilot, Auggie and Grok.☆17Aug 8, 2026Updated 3 weeks ago
- content aware image resizing in Rust☆22Jul 19, 2026Updated last month
- A lightweight, type-safe service construction pattern for Rust applications that leverages the builder pattern.☆10Aug 16, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Helper for macro_rules authors to chain their macros with builtin ones (such as `env!`, `include!`, or `concat_idents!`).☆18Apr 10, 2024Updated 2 years ago
- rust-rustlings-2024-autumn-rustlings-rust-rustlings-2024-autumn-template-1 created by GitHub Classroom☆16Sep 25, 2024Updated last year
- A simple and likely improvable Hangman Game created using the Rust Programming Language.☆13Dec 30, 2017Updated 8 years ago
- An OS X kext written partly in the Rust programming language.☆21Aug 2, 2015Updated 11 years ago
- Modern OS written in the rust programming language☆14Jun 25, 2025Updated last year
- Rust natural language processing model with a focus on mapping back to source and "layerable" recognizers☆19Jan 3, 2022Updated 4 years ago
- Lint your file tree based on file sizes☆16Aug 1, 2026Updated 3 weeks ago
- 🦀 📚 🧑🎓 Aprendendo Rust | Learning Rust - Personal Studies about Rust Language☆10Aug 10, 2023Updated 3 years ago
- ☆64Apr 28, 2021Updated 5 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Locate local installations of the Wolfram Language.☆18Jun 15, 2026Updated 2 months ago
- A fairly comprehensive set of snippets for the Rust programming language☆16Jan 31, 2020Updated 6 years ago
- Tremor Language Server (Trill)☆13Apr 18, 2024Updated 2 years ago
- A simple terminal UI framework☆20Aug 14, 2026Updated 2 weeks ago
- Can you kick it?☆21Aug 10, 2026Updated 2 weeks ago
- Using cross-language LTO in Rust project☆12Aug 15, 2021Updated 5 years ago
- ⛵ Basic Opinionated Activity Tracker, a command line interface inspired by bartib.☆17Jul 7, 2026Updated last month