aichat-bot / crawlyLinks
A lightweight async Web crawler in Rust, optimized for concurrent scraping while respecting `robots.txt` rules.
☆25Updated last year
Alternatives and similar repositories for crawly
Users that are interested in crawly are comparing it to the libraries listed below
Sorting:
- Simple string matching with single- and multiple-wildcard operator☆86Updated 8 months ago
- ✴️ An experimental graph database☆112Updated last year
- Comparison of Rust string types☆151Updated last week
- Atomically updatable variants of Arc and Weak for lock-free concurrency.☆182Updated 8 months ago
- An adapter to easily run an Axum server in a Cloudflare worker.☆80Updated last week
- Reports when tokio runtime threads are blocking☆64Updated 9 months ago
- End-to-end encryption sdk with user management.☆45Updated last month
- Opinionated framework for web services☆30Updated last month
- A literal string obfuscation library for rust projects☆87Updated 3 months ago
- ☆21Updated 2 months ago
- Task runner and process manager for Rust☆52Updated 8 months ago
- Parallelo Parallel Library (PPL) is a small parallel framework that brings Structured Parallel Programming in Rust.☆77Updated this week
- A Rust crate providing an implementation of an RFC-compliant `EmailAddress` newtype.☆79Updated 7 months ago
- Common stop words in a variety of languages☆21Updated 4 months ago
- Extism Plug-in Development Kit (PDK) for Rust☆59Updated last week
- 🔎 Prometheus metrics middleware for Axum☆73Updated this week
- Rust crate to retrieve public IP address and geolocation data. 🦀☆36Updated this week
- A token-based rate limiter based on the leaky bucket algorithm.☆110Updated 2 months ago
- A very fast Key-Value store in pure rust☆162Updated last week
- A cargo subcommand that extends cargo's capabilities when it comes to code generation.☆58Updated 7 months ago
- Rust bindings for Binaryen's wasm-opt☆73Updated last year
- Include your assets statically into your application with a strict structure☆88Updated 3 months ago
- Rust web servers without async/await.☆207Updated 5 months ago
- Framework to fuzz Rust/Tauri applications based on behavior policies☆53Updated 5 months ago
- A very fast HTTP Server based on Hyper and Rust☆87Updated last year
- Helper to build an Eventsource using reqwest☆60Updated last year
- 🦗 Grillon, an elegant and natural way to approach API testing in Rust.☆123Updated last month
- Run shell scripts in rust.☆126Updated 8 months ago
- A GraphQL over Websockets implementation for Rust☆41Updated 7 months ago
- A more compact help renderer for clap terminal applications☆77Updated last month