yigitkonur / rust-10k-req-demo

A high-performance Rust tool for sending API requests (to LLMs in my case) with built-in weighted load balancing, retry mechanisms, and rate limiting. Using hyper for fast request handling, it manages large volumes of asynchronous requests and is optimized for 10K request per second.
16Updated 11 months ago

Alternatives and similar repositories for rust-10k-req-demo

Users that are interested in rust-10k-req-demo are comparing it to the libraries listed below

Sorting: