A lightweight, single-binary LLM inference engine built in Rust. It offers low-latency token streaming, continuous batching, and memory-efficient caching via an OpenAI-compatible API
☆23Aug 24, 2026Updated this week
Alternatives and similar repositories for rLLM
Users that are interested in rLLM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Pure-Rust LLM runtime: one binary serves (OpenAI-compatible), runs local agents, and distills models on their own rollouts — on Apple Sil…☆18Updated this week
- Cardano mainchain data on BigQuery☆11Aug 3, 2023Updated 3 years ago
- OmniDaemon is a Universal Event-Driven Runtime for AI Agents, it's framework-agnostic, event-driven runtime that turns AI agents into pr…☆55Dec 15, 2025Updated 8 months ago
- A realworld implementation using purescript-deku☆10Apr 28, 2024Updated 2 years ago
- Many-to-many broadcasting☆16Apr 27, 2022Updated 4 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆10Aug 17, 2014Updated 12 years ago
- ☆12Nov 21, 2024Updated last year
- Determinate CI is the one-stop shop for effortless Nix CI in GitHub Actions.☆15Aug 12, 2026Updated 2 weeks ago
- AI coder powered by open source LLMs☆11Nov 28, 2024Updated last year
- Organize JavaScript packages with the Nix package manager☆14Dec 31, 2023Updated 2 years ago
- ☆14Jul 14, 2026Updated last month
- ☆11Aug 23, 2026Updated last week
- Provides a Purescript wrapper around react-testing-library to be used with purescript-react-basic-hooks☆16May 27, 2026Updated 3 months ago
- ☆15Sep 28, 2022Updated 3 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆13Dec 15, 2025Updated 8 months ago
- ☆16Feb 9, 2024Updated 2 years ago
- Just a little spec(k).☆15May 16, 2022Updated 4 years ago
- Argonaut codecs for aeson generic encoding☆12Dec 24, 2022Updated 3 years ago
- A Slack Bot for Epic Card Game☆11Mar 5, 2023Updated 3 years ago
- VuePress authentication plugin☆13Aug 16, 2019Updated 7 years ago
- Necesary scripts for miniting NFTs in the cardano blockchain using the NFT factory.☆10Oct 10, 2021Updated 4 years ago
- A set of useful cryptographic utilities for blockchain development.☆12Sep 15, 2022Updated 3 years ago
- Type Level Regular Expressions☆13Sep 26, 2023Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Open-source test harness for AI agents. Stress-test production agents with adversarial multi-turn scenarios in CI☆27Aug 14, 2026Updated 2 weeks ago
- ☆13Oct 16, 2018Updated 7 years ago
- This element will fire the event when the scroll to the top and bottom.☆10May 26, 2016Updated 10 years ago
- the ever-shifting depths of the Underworld are not as once they were...☆17Aug 3, 2026Updated 3 weeks ago
- ☆17Feb 23, 2026Updated 6 months ago
- State machines with async I/O capabilities☆12Apr 13, 2023Updated 3 years ago
- ☆17Updated this week
- ☆14May 22, 2025Updated last year
- Faucet for Cardano☆10Aug 18, 2026Updated last week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- NixOS-based USB rescue image☆18Oct 30, 2023Updated 2 years ago
- The PureScript Domain offers free vanity URLs for PureScript libraries and community resources.☆13Aug 14, 2024Updated 2 years ago
- A unidirectional value-based JSON codec library.☆15Oct 9, 2023Updated 2 years ago
- Algorithmically solve Slay the Spire☆19Oct 7, 2022Updated 3 years ago
- Events, behaviors, and uneventful misbehaving☆18Apr 13, 2026Updated 4 months ago
- Routing management for Halogen☆16May 6, 2022Updated 4 years ago
- Automate AI testing & ensure model trustworthiness☆13Nov 16, 2024Updated last year