Folyd / robotstxtLinks
A native Rust port of Google's robots.txt parser and matcher C++ library.
☆99Updated 4 years ago
Alternatives and similar repositories for robotstxt
Users that are interested in robotstxt are comparing it to the libraries listed below
Sorting:
- Heap-based async timers☆217Updated last year
- Types and traits for http clients☆115Updated 2 years ago
- An updated version of linked-hash-map and friends☆139Updated 3 months ago
- In Rust, format Duration into a string like "1 hour ago" or "01hou".☆73Updated 3 weeks ago
- Asynchronous HTTP/1.1 in Rust☆165Updated 2 years ago
- Streamline updating a Tokio 0.1 application to Tokio 0.2.☆52Updated 5 years ago
- path-tree is a lightweight high performance HTTP request router for Rust☆132Updated last month
- Async filesystem primitives☆143Updated 3 months ago
- Async tracing capabilities for the log crate☆98Updated 5 years ago
- An LCS based slice and string diffing implementation.☆89Updated 2 years ago
- ☆126Updated 3 years ago
- Executor Agnostic Runtime that can run your futures with your favourite Executor☆144Updated 4 years ago
- Copy-on-write string utilities for Rust☆162Updated last year
- Compatibility adapter between tokio and futures☆188Updated 2 weeks ago
- Common types for HTTP operations☆207Updated last year
- An async parser for multipart/form-data content-type in Rust☆163Updated last year
- Recognizes URL patterns with support for dynamic and wildcard segments☆100Updated 3 years ago
- Async networking primitives for TCP/UDP/Unix communication☆140Updated last year
- Run closures in parallel☆114Updated last year
- Native TLS for futures and async-std☆72Updated 8 months ago
- Data parallelism library for async-std.☆96Updated last year
- Serde support for querystring-style strings☆224Updated this week
- Macros for deriving as functions to access Enums as their inner components☆104Updated this week
- "just open a socket"☆73Updated 2 years ago
- A tar archive reading/writing library for async Rust.☆74Updated 2 weeks ago
- ☆63Updated 4 years ago
- A TLS implementation over AsyncRead and AsyncWrite☆169Updated last year
- Abstraction over std::Instant and tokio_timer that works on WASM☆78Updated 3 years ago
- File locking for Rust.☆45Updated 4 months ago
- Duplicate an async I/O handle☆41Updated last year