yigitkonur / rust-hyper-load-balanced-api-client
A high-performance Rust tool for sending API requests (to LLMs in my case) with built-in weighted load balancing, retry mechanisms, and rate limiting. Using hyper for fast request handling, it manages large volumes of asynchronous requests and is optimized for 10K request per second.
☆15Updated 8 months ago
Alternatives and similar repositories for rust-hyper-load-balanced-api-client:
Users that are interested in rust-hyper-load-balanced-api-client are comparing it to the libraries listed below
- a lightweight and simple cli package☆13Updated 3 years ago
- Server load testing CLI tool 🏋️☆10Updated last year
- Python script for automated clustering of embeddings with DBSCAN, using cosine similarity for flexible, size-agnostic grouping (I hate K-…☆9Updated last year
- Go-based task queue with MongoDB storage for distributed app tasks☆14Updated 10 months ago
- A graceful shutdown implementation for Go 🧨☆9Updated 2 years ago
- Basic CLI for format Json, HTML and XML Yaml!☆32Updated 9 months ago
- gopacket log4shell detect and mitigation example☆17Updated 3 years ago
- Telegram bot that sends messages about your Gitlab CI job status☆13Updated 4 years ago
- A repository trying to translate subtitles with GPT 3.5 Turbo without losing context (using the dynamic window context method).☆30Updated last year
- Higher level abstraction for franz-go.☆23Updated 2 years ago
- Idiomatic way to fill structs with options logic☆13Updated 3 years ago
- simple webshell scanner☆48Updated 3 years ago
- My personal website☆26Updated 7 months ago
- It serves to visualize the muninn configs you have prepared.☆20Updated 3 years ago
- Takım arkadaşım Altay Şimşek ile birlikte Havelsan Ekspres Hackathonunda geliştirdiğimiz OpenVPN eklentisi.☆17Updated 2 years ago
- ☆11Updated 3 years ago
- Üstün web teknolojisi destekli yeni nesil açık kaynak mainframe projesi☆8Updated 3 years ago
- Learning Rust with writing interesting apps. This project can create and store your backups.☆13Updated 3 years ago
- Hızlıca Regex öğrenebileceğiniz pratik bir eğitim.☆10Updated 4 years ago
- ☆13Updated 3 years ago
- https://fastreadingtool.netlify.app/☆14Updated 3 years ago
- Web application for makes urls more shorter. It was made with uses gin framework.☆8Updated 3 years ago
- Findmentor.network backend project☆22Updated 3 years ago
- Müşahit Haritası Backend Api Kodları☆21Updated last year
- ☆18Updated 2 months ago
- Chrome Keylogger Extension☆13Updated 2 years ago
- Go http real ip header parser☆24Updated 3 years ago
- https://deskstory.netlify.app/☆15Updated 3 years ago
- A tool that finds related serp results for the given input.☆11Updated 4 years ago
- https://kommunity.com/goturkiye/events/go-ile-network-programlama-97094b41☆13Updated 3 years ago