Folyd / robotstxtLinks
A native Rust port of Google's robots.txt parser and matcher C++ library.
☆99Updated 4 years ago
Alternatives and similar repositories for robotstxt
Users that are interested in robotstxt are comparing it to the libraries listed below
Sorting:
- Asynchronous HTTP/1.1 in Rust☆165Updated 2 years ago
- Heap-based async timers☆216Updated last year
- An updated version of linked-hash-map and friends☆139Updated 3 months ago
- path-tree is a lightweight high performance HTTP request router for Rust☆132Updated last month
- MIMEs in Rust☆208Updated last year
- An async parser for multipart/form-data content-type in Rust☆163Updated last year
- Common types for HTTP operations☆207Updated last year
- Asynchronous HTTP body trait☆152Updated 2 months ago
- Types and traits for http clients☆115Updated 2 years ago
- Copy-on-write string utilities for Rust☆162Updated last year
- A TLS implementation over AsyncRead and AsyncWrite☆168Updated last year
- Typed HTTP Headers from hyper☆191Updated 2 months ago
- In Rust, format Duration into a string like "1 hour ago" or "01hou".☆73Updated last week
- Async networking primitives for TCP/UDP/Unix communication☆140Updated last year
- Compatibility adapter between tokio and futures☆188Updated last week
- Utility wrapper to send non send types to other threads safely☆185Updated 10 months ago
- Streamline updating a Tokio 0.1 application to Tokio 0.2.☆52Updated 5 years ago
- Async filesystem primitives☆143Updated 2 months ago
- Async tracing capabilities for the log crate☆98Updated 5 years ago
- Async session support with plugabble backends☆126Updated 2 years ago
- bencher is just a port of the libtest (unstable) benchmark runner to Rust stable releases. `cargo bench` on stable. "Not a better bencher…☆91Updated 3 years ago
- ☆241Updated this week
- A library for interaction with units of bytes.☆59Updated last month
- Serde support for querystring-style strings☆223Updated 2 weeks ago
- An LCS based slice and string diffing implementation.☆89Updated last year
- A implementation of convenience integrations between tokio and tower☆134Updated 2 years ago
- A simple, fast, LRU cache implementation.☆213Updated last year
- A Rust library for interrupting asynchronous streams.☆166Updated last year
- Idiomatic argon2 password hashing for several languages☆146Updated 3 years ago
- MIME type guessing of file extensions for Rust.☆196Updated 4 months ago