Folyd / robotstxtLinks
A native Rust port of Google's robots.txt parser and matcher C++ library.
☆99Updated 4 years ago
Alternatives and similar repositories for robotstxt
Users that are interested in robotstxt are comparing it to the libraries listed below
Sorting:
- Types and traits for http clients☆115Updated 2 years ago
- Heap-based async timers☆217Updated last year
- MIMEs in Rust☆210Updated last year
- path-tree is a lightweight high performance HTTP request router for Rust☆132Updated last month
- An async parser for multipart/form-data content-type in Rust☆163Updated last year
- Asynchronous HTTP/1.1 in Rust☆165Updated 2 years ago
- In Rust, format Duration into a string like "1 hour ago" or "01hou".☆73Updated 3 weeks ago
- Streamline updating a Tokio 0.1 application to Tokio 0.2.☆52Updated 5 years ago
- Native TLS for futures and async-std☆72Updated 8 months ago
- A Rust library for interrupting asynchronous streams.☆166Updated last year
- Async tracing capabilities for the log crate☆98Updated 5 years ago
- ☆63Updated 4 years ago
- Serde support for querystring-style strings☆227Updated last week
- Minimal non-blocking I/O for Rust☆171Updated last year
- "just open a socket"☆73Updated 2 years ago
- A rust logger that routes messages to the browser's console.☆103Updated 9 months ago
- Common types for HTTP operations☆207Updated last year
- bencher is just a port of the libtest (unstable) benchmark runner to Rust stable releases. `cargo bench` on stable. "Not a better bencher…☆91Updated 3 years ago
- Async networking primitives for TCP/UDP/Unix communication☆140Updated last year
- Asynchronous HTTP body trait☆152Updated 2 months ago
- Compatibility adapter between tokio and futures☆188Updated 2 weeks ago
- Async filesystem primitives☆143Updated 3 months ago
- Scoped Thread Local Storage for Rust☆59Updated 2 years ago
- Copy-on-write string utilities for Rust☆162Updated last year
- Utility wrapper to send non send types to other threads safely☆186Updated 10 months ago
- Run closures in parallel☆114Updated last year
- Async session support with plugabble backends☆125Updated 2 years ago
- An updated version of linked-hash-map and friends☆141Updated 3 months ago
- A TLS implementation over AsyncRead and AsyncWrite☆169Updated last year
- Recognizes URL patterns with support for dynamic and wildcard segments☆100Updated 3 years ago