Folyd / robotstxtLinks
A native Rust port of Google's robots.txt parser and matcher C++ library.
☆99Updated 4 years ago
Alternatives and similar repositories for robotstxt
Users that are interested in robotstxt are comparing it to the libraries listed below
Sorting:
- Heap-based async timers☆214Updated last year
- Asynchronous HTTP/1.1 in Rust☆164Updated last year
- path-tree is a lightweight high performance HTTP request router for Rust☆131Updated 3 months ago
- In Rust, format Duration into a string like "1 hour ago" or "01hou".☆72Updated last month
- Compatibility adapter between tokio and futures☆183Updated last month
- MIMEs in Rust☆207Updated 11 months ago
- Types and traits for http clients☆115Updated 2 years ago
- An async parser for multipart/form-data content-type in Rust☆161Updated last year
- Asynchronous HTTP body trait☆147Updated last month
- Async tracing capabilities for the log crate☆98Updated 4 years ago
- Async filesystem primitives☆139Updated 2 weeks ago
- A sha1 implementation useable in const contexts☆87Updated last year
- A rust logger that routes messages to the browser's console.☆100Updated 5 months ago
- Async networking primitives for TCP/UDP/Unix communication☆136Updated 8 months ago
- Minimal non-blocking I/O for Rust☆169Updated 9 months ago
- An updated version of linked-hash-map and friends☆127Updated 5 months ago
- Async session support with plugabble backends☆126Updated 2 years ago
- Duplicate an async I/O handle☆41Updated 8 months ago
- Streamline updating a Tokio 0.1 application to Tokio 0.2.☆51Updated 4 years ago
- ☆62Updated 3 years ago
- A TLS implementation over AsyncRead and AsyncWrite☆167Updated last year
- Common types for HTTP operations☆206Updated last year
- Thread parking and unparking☆79Updated 8 months ago
- ☆223Updated last month
- Executor Agnostic Runtime that can run your futures with your favourite Executor☆144Updated 4 years ago
- Run closures in parallel☆115Updated 8 months ago
- An LCS based slice and string diffing implementation.☆85Updated last year
- Serde support for querystring-style strings☆217Updated 4 months ago
- User Agent Parser for Rust☆48Updated last year
- JOSE (JSON Web Token) Library for Rust☆181Updated 4 months ago