A lightweight, single-binary LLM inference engine built in Rust. It offers low-latency token streaming, continuous batching, and memory-efficient caching via an OpenAI-compatible API
☆27Oct 11, 2026Updated 2 weeks ago
Alternatives and similar repositories for rLLM
Users that are interested in rLLM are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The local inference server for coding agents. Pure Rust, one binary, Apple Silicon + NVIDIA. Anthropic + OpenAI APIs; the KV cache surviv…☆20Oct 1, 2026Updated 3 weeks ago
- ☆13Sep 9, 2026Updated last month
- Benchmark Heaven: AI model benchmarks with sources and modeled costs, plus the JevBench and ImageJevBench decision model leaderboards.☆22Updated this week
- learn mojo☆10May 6, 2026Updated 5 months ago
- MCP server that connects Claude to local Ollama models, delegating simple tasks to save tokens for complex reasoning☆16Oct 23, 2026Updated last week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆12May 3, 2012Updated 14 years ago
- A JavaScript implementation from scratch of an online gradient descent neural network using some functional programming principles.☆10Aug 31, 2019Updated 7 years ago
- A Rust terminal agent harness for multi-provider models, with tools, permissions, sessions, cost tracking, and isolated evaluations.☆21Updated this week
- OmniDaemon is a Universal Event-Driven Runtime for AI Agents, it's framework-agnostic, event-driven runtime that turns AI agents into pr…☆56Dec 15, 2025Updated 10 months ago
- A Curated Collection of Frontier Language Model Architectures☆14Jan 30, 2026Updated 9 months ago
- ☆12Dec 28, 2023Updated 2 years ago
- Skill-Madness — all the skills, all the agents, all the chaos.☆11Updated this week
- ☆20Nov 18, 2024Updated last year
- ☆11Jun 12, 2012Updated 14 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆14Oct 10, 2024Updated 2 years ago
- Vim configuration files for Mojo🔥☆15Sep 10, 2026Updated last month
- Implementation of the sped-up solver of LIME image enhancement algorithm from the paper "LIME: Low-Light Image Enhancement via Illuminati…☆11Jan 9, 2024Updated 2 years ago
- ☆13Nov 8, 2024Updated last year
- Generate lenses and prisms for your data types automatically.☆12Jan 8, 2022Updated 4 years ago
- A realworld implementation using purescript-deku☆10Apr 28, 2024Updated 2 years ago
- Higher-order FRP for PureScript☆13Dec 24, 2022Updated 3 years ago
- Cardano mainchain data on BigQuery☆11Aug 3, 2023Updated 3 years ago
- Benchmark evaluating LLMs on their ability to create and resist disinformation. Includes comprehensive testing across major models (Claud…☆36Mar 20, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- 🧬 Viral genome reference alignment☆12Jan 26, 2021Updated 5 years ago
- Purescript code printer, inspired by official purescript-cst types https://hackage.haskell.org/package/purescript/docs/Language-PureScrip…☆10Nov 26, 2021Updated 4 years ago
- A stronger one-pass scorer over a variable list of text options. Hashed n-gram encoder, rival-aware attention, gated head, temperature sc…☆16Sep 16, 2026Updated last month
- A small, readable PyTorch inference engine for Qwen3-4B with continuous batching, native paged attention, prefix caching, and an OpenAI-c…☆18Oct 24, 2026Updated last week
- Many-to-many broadcasting☆16Oct 11, 2026Updated 2 weeks ago
- MilimoChat: Privacy-first, self-hosted AI chat with customizable personas, context-aware memory, and local analytics. Built on Python/Str…☆14Mar 12, 2025Updated last year
- Find fabricated ("hallucinated") references in academic paper PDF files.☆16Updated this week
- ☆11Jan 23, 2023Updated 3 years ago
- Client-side javascript SDK for the IBM Cloud App ID service☆10May 12, 2026Updated 5 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- [NeurIPS 2026] Code and data for paper "Model-Adaptive Tool Necessity Reveals the Knowing-Doing Gap in LLM Tool Use"☆19Sep 24, 2026Updated last month
- ☆12Nov 21, 2024Updated last year
- ☆15Sep 13, 2026Updated last month
- Your AI memory. Versioned. Portable. Yours.☆14May 16, 2026Updated 5 months ago
- PIBench is an open-source benchmark for evaluating AI coding agents on realistic, end-to-end payment integration tasks.☆27Aug 6, 2026Updated 2 months ago
- Overview of PureScript libraries/tools for Cardano☆11Jul 25, 2024Updated 2 years ago
- Esbuild plugin for importing WebAssembly files☆15Jun 22, 2022Updated 4 years ago