Folyd / robotstxtLinks
A native Rust port of Google's robots.txt parser and matcher C++ library.
☆99Updated 4 years ago
Alternatives and similar repositories for robotstxt
Users that are interested in robotstxt are comparing it to the libraries listed below
Sorting:
- Heap-based async timers☆214Updated last year
- In Rust, format Duration into a string like "1 hour ago" or "01hou".☆72Updated 3 weeks ago
- MIMEs in Rust☆203Updated 9 months ago
- An async parser for multipart/form-data content-type in Rust☆160Updated last year
- Asynchronous HTTP body trait☆146Updated 3 weeks ago
- Native TLS for futures and async-std☆72Updated 2 months ago
- Async filesystem primitives☆137Updated last month
- Compatibility adapter between tokio and futures☆175Updated last week
- path-tree is a lightweight high performance HTTP request router for Rust☆130Updated last month
- Serde support for querystring-style strings☆214Updated 2 months ago
- Async tracing capabilities for the log crate☆99Updated 4 years ago
- Thread parking and unparking☆77Updated 7 months ago
- Asynchronous HTTP/1.1 in Rust☆163Updated last year
- Copy-on-write string utilities for Rust☆159Updated last year
- Streamline updating a Tokio 0.1 application to Tokio 0.2.☆51Updated 4 years ago
- A rust logger that routes messages to the browser's console.☆99Updated 3 months ago
- Types and traits for http clients☆115Updated 2 years ago
- A TLS implementation over AsyncRead and AsyncWrite☆167Updated last year
- Utility wrapper to send non send types to other threads safely☆184Updated 4 months ago
- Common types for HTTP operations☆206Updated last year
- ☆216Updated last week
- A Rust library for interrupting asynchronous streams.☆165Updated 7 months ago
- Async session support with plugabble backends☆124Updated 2 years ago
- Data parallelism library for async-std.☆94Updated last year
- A sha1 implementation useable in const contexts☆87Updated last year
- An updated version of linked-hash-map and friends☆122Updated 4 months ago
- A global executor built on top of async-executor and smol☆74Updated last week
- A implementation of convenience integrations between tokio and tower☆130Updated last year
- Define your own PhantomData☆156Updated last week
- Abstraction over std::Instant and tokio_timer that works on WASM☆75Updated 3 years ago