yigitkonur / rust-hyper-load-balanced-api-client
A high-performance Rust tool for sending API requests (to LLMs in my case) with built-in weighted load balancing, retry mechanisms, and rate limiting. Using hyper for fast request handling, it manages large volumes of asynchronous requests and is optimized for 10K request per second.
☆14Updated 4 months ago
Related projects ⓘ
Alternatives and complementary repositories for rust-hyper-load-balanced-api-client
- Server load testing CLI tool 🏋️☆10Updated last year
- a lightweight and simple cli package☆13Updated 2 years ago
- Python script for automated clustering of embeddings with DBSCAN, using cosine similarity for flexible, size-agnostic grouping (I hate K-…☆8Updated 9 months ago
- Telegram bot that sends messages about your Gitlab CI job status☆13Updated 4 years ago
- Basic CLI for format Json, HTML and XML Yaml!☆32Updated 5 months ago
- Git folder digger, I'm sure it's worthwhile stuff.☆38Updated 3 years ago
- Go-based task queue with MongoDB storage for distributed app tasks☆14Updated 7 months ago
- Findmentor.network backend project☆22Updated 3 years ago
- A repository trying to translate subtitles with GPT 3.5 Turbo without losing context (using the dynamic window context method).☆29Updated last year
- Spotify Web API wrapper for Cloudflare Workers☆18Updated last year
- 📮 Lightweight, high performance and configurable API rate limiter.☆14Updated 3 years ago
- An example repository of using the Twirp RPC framework with Go☆33Updated 2 years ago
- Hızlıca Regex öğrenebileceğiniz pratik bir eğitim.☆10Updated 3 years ago
- It serves to visualize the muninn configs you have prepared.☆21Updated 2 years ago
- Learning Rust with writing interesting apps. This project can create and store your backups.☆13Updated 2 years ago
- Binalyze logger is an easily customizable wrapper for logrus with log rotation☆28Updated 3 years ago
- gopacket log4shell detect and mitigation example☆16Updated 2 years ago
- A graceful shutdown implementation for Go 🧨☆9Updated 2 years ago
- Secure image creator with wolfi packages.☆36Updated 6 months ago
- Making homepage clone example of wope.com site with Angular framework.☆10Updated last year
- Code and slides for Kodla 2022☆23Updated 2 years ago
- Generates the tree of the directory listing page.☆48Updated 4 months ago
- simple webshell scanner☆48Updated 3 years ago
- Üstün web teknolojisi destekli yeni nesil açık kaynak mainframe projesi☆8Updated 3 years ago
- Developer's Helper to Docker, Kubernetes, and Terraform. Fully automatic, without any config or question 🙌☆79Updated 3 years ago
- ☆35Updated last year
- Enter a GitHub username and get to know its followers, followers' profiles, add them to your favorites☆15Updated 2 years ago
- My personal website☆26Updated 4 months ago
- Multi cluster kubernetes dashboard with batteries included. Build by developers, for developers.☆34Updated 3 years ago