yigitkonur / rust-hyper-load-balanced-api-client

A high-performance Rust tool for sending API requests (to LLMs in my case) with built-in weighted load balancing, retry mechanisms, and rate limiting. Using hyper for fast request handling, it manages large volumes of asynchronous requests and is optimized for 10K request per second.
14Updated 7 months ago

Alternatives and similar repositories for rust-hyper-load-balanced-api-client:

Users that are interested in rust-hyper-load-balanced-api-client are comparing it to the libraries listed below