A lightweight, single-binary LLM inference engine built in Rust. It offers low-latency token streaming, continuous batching, and memory-efficient caching via an OpenAI-compatible API
☆23Jul 30, 2026Updated last week
Alternatives and similar repositories for rLLM
Users that are interested in rLLM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Stable diffusion dedicated Hardware with multiple pipelined processor cores☆14Apr 9, 2026Updated 4 months ago
- Cardano mainchain data on BigQuery☆11Aug 3, 2023Updated 3 years ago
- A realworld implementation using purescript-deku☆10Apr 28, 2024Updated 2 years ago
- Many-to-many broadcasting☆16Apr 27, 2022Updated 4 years ago
- Generate lenses and prisms for your data types automatically.☆12Jan 8, 2022Updated 4 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Higher-order FRP for PureScript☆13Dec 24, 2022Updated 3 years ago
- ☆12Nov 21, 2024Updated last year
- 🧬 Viral genome reference alignment☆12Jan 26, 2021Updated 5 years ago
- AI coder powered by open source LLMs☆11Nov 28, 2024Updated last year
- Organize JavaScript packages with the Nix package manager☆14Dec 31, 2023Updated 2 years ago
- A Log-Rectilinear Transformation for Foveated 360-degree Video Streaming (TVCG 2021)☆20Mar 6, 2024Updated 2 years ago
- ☆13Jul 14, 2026Updated 3 weeks ago
- ☆17May 26, 2026Updated 2 months ago
- ATS言語に関する文書の日本語訳置き場☆21Nov 4, 2020Updated 5 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆11Aug 1, 2026Updated last week
- a battery-included library for dataflow protocols☆24Jul 21, 2026Updated 2 weeks ago
- Provides a Purescript wrapper around react-testing-library to be used with purescript-react-basic-hooks☆15May 27, 2026Updated 2 months ago
- A guided tour through https://github.com/bitemyapp/learnhaskell☆14May 7, 2015Updated 11 years ago
- ☆15Sep 28, 2022Updated 3 years ago
- ☆13Dec 15, 2025Updated 7 months ago
- ☆16Jul 10, 2021Updated 5 years ago
- Esbuild plugin for importing WebAssembly files☆15Jun 22, 2022Updated 4 years ago
- ☆16Feb 9, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Just a little spec(k).☆15May 16, 2022Updated 4 years ago
- Argonaut codecs for aeson generic encoding☆12Dec 24, 2022Updated 3 years ago
- A Slack Bot for Epic Card Game☆11Mar 5, 2023Updated 3 years ago
- 📀 You finally scored a record deal.☆11Apr 11, 2023Updated 3 years ago
- VuePress authentication plugin☆13Aug 16, 2019Updated 6 years ago
- Necesary scripts for miniting NFTs in the cardano blockchain using the NFT factory.☆10Oct 10, 2021Updated 4 years ago
- A set of useful cryptographic utilities for blockchain development.☆12Sep 15, 2022Updated 3 years ago
- Type Level Regular Expressions☆13Sep 26, 2023Updated 2 years ago
- ☆13Oct 16, 2018Updated 7 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- This element will fire the event when the scroll to the top and bottom.☆10May 26, 2016Updated 10 years ago
- the ever-shifting depths of the Underworld are not as once they were...☆17Updated this week
- ☆17Feb 23, 2026Updated 5 months ago
- College assignment writing in which I ramble about type classes and dependent types.☆11Dec 11, 2020Updated 5 years ago
- State machines with async I/O capabilities☆12Apr 13, 2023Updated 3 years ago
- A small PureScript only MVC library☆13Jan 6, 2023Updated 3 years ago
- Rogue Reborn is a modern port of Rainbow Six: Rogue Spear.☆17Jan 10, 2011Updated 15 years ago