rodmarkun / flyllmLinks
A rust library for unifying LLM backends as an abstraction layer with load balancing and parallel generation.
☆14Updated 3 weeks ago
Alternatives and similar repositories for flyllm
Users that are interested in flyllm are comparing it to the libraries listed below
Sorting:
- Command-line tool to make Rust source code entities from Postgres tables.☆11Updated 3 years ago
- Glommio Messaging Framework (GMF) is a high-performance RPC system designed to work with the Glommio framework.☆54Updated 2 years ago
- axum::ws with type safe messages☆23Updated last year
- Distributed SQLite☆17Updated last year
- A Rust in-memory embedded database with persistence and multiple adapters (JSON, CSV, etc). Acts like a minimalistic ORM with zero setup.…☆49Updated 2 months ago
- This crate implements runtime-agnostic driver for async timers and scheduled tasks.☆48Updated last month
- A new schemaless, high-performance database written from scratch in Rust. https://crates.io/crates/rasterizeddb_core☆20Updated this week
- Framework to build data pipelines declaratively☆57Updated last week
- ☆16Updated 8 months ago
- Advanced futures library☆17Updated 2 weeks ago
- A highly customable, adaptable, runtime agnostic and WASM/WASI friendly decentralized solution for service discovery and orchestration th…☆52Updated 3 months ago
- A distributed sliding window rate limiter built with Tokio/Tower☆28Updated 5 months ago
- A Spreadsheet with the Feldera Engine☆29Updated last week
- Provides utilities for collecting Prometheus-compatible metrics from Tokio runtime and tasks.☆32Updated last month
- WhitePool is a lightweight, generic pooling library for Rust+Tokio☆17Updated 2 years ago
- Create local first, peer to peer application (P2P) using a GraphQL inspired API☆20Updated 9 months ago
- A loadable Redis module that implements the token bucket algorithm to do rate limiting as a native command☆50Updated this week
- in memory Rust database to query your data like a Venn diagram☆108Updated 7 months ago
- A Rust streaming library☆19Updated this week
- ☆19Updated 9 months ago
- A watchdog utility for tokio runtimes☆14Updated last month
- A test framework for Rust☆21Updated 3 weeks ago
- Sled datastore for IndraDB☆11Updated 11 months ago
- Value log implementation for key-value separated storage in safe Rust☆41Updated 3 weeks ago
- An extremely dev-friendly, composable messaging platform☆57Updated 11 months ago
- Fast and efficient Markov Chain implementation, optimized for text generation.☆29Updated 5 months ago
- Optics library for rust☆39Updated 3 weeks ago
- Create Kafaka-like things while enjoying low-level programming without external crates☆91Updated 3 weeks ago
- Thread-safe clone-on-write container for fast concurrent writing and reading.☆49Updated 2 years ago
- Rewrite of Andrej Karpathy makemore character level language model.☆23Updated 4 months ago