Folyd / robotstxtLinks
A native Rust port of Google's robots.txt parser and matcher C++ library.
☆99Updated 4 years ago
Alternatives and similar repositories for robotstxt
Users that are interested in robotstxt are comparing it to the libraries listed below
Sorting:
- Heap-based async timers☆215Updated last year
- Asynchronous HTTP/1.1 in Rust☆164Updated 2 years ago
- path-tree is a lightweight high performance HTTP request router for Rust☆131Updated 3 months ago
- Types and traits for http clients☆115Updated 2 years ago
- Native TLS for futures and async-std☆72Updated 4 months ago
- MIMEs in Rust☆208Updated 11 months ago
- In Rust, format Duration into a string like "1 hour ago" or "01hou".☆72Updated last month
- Common types for HTTP operations☆206Updated last year
- Typed HTTP Headers from hyper☆188Updated last month
- Asynchronous HTTP body trait☆149Updated last month
- An async parser for multipart/form-data content-type in Rust☆161Updated last year
- An updated version of linked-hash-map and friends☆129Updated last week
- Compatibility adapter between tokio and futures☆184Updated 2 months ago
- Abstraction over std::Instant and tokio_timer that works on WASM☆76Updated 3 years ago
- Async tracing capabilities for the log crate☆98Updated 4 years ago
- Thread parking and unparking☆79Updated 9 months ago
- Streamline updating a Tokio 0.1 application to Tokio 0.2.☆52Updated 4 years ago
- Utility wrapper to send non send types to other threads safely☆188Updated 7 months ago
- A rust logger that routes messages to the browser's console.☆100Updated 5 months ago
- Minimal non-blocking I/O for Rust☆170Updated 9 months ago
- A library for interaction with units of bytes.☆58Updated 2 months ago
- Async filesystem primitives☆139Updated last month
- bencher is just a port of the libtest (unstable) benchmark runner to Rust stable releases. `cargo bench` on stable. "Not a better bencher…☆90Updated 3 years ago
- Not just a pretty (inter)face: pretty-printer + ndjson logger for log crate.☆177Updated 3 years ago
- A TLS implementation over AsyncRead and AsyncWrite☆168Updated last year
- A Rust library for interrupting asynchronous streams.☆168Updated 9 months ago
- Are we async yet?☆213Updated 7 months ago
- ☆226Updated 2 months ago
- Rate limiter framework for Actix web☆126Updated 2 years ago
- Async networking primitives for TCP/UDP/Unix communication☆137Updated 9 months ago