Folyd / robotstxtLinks
A native Rust port of Google's robots.txt parser and matcher C++ library.
☆99Updated 4 years ago
Alternatives and similar repositories for robotstxt
Users that are interested in robotstxt are comparing it to the libraries listed below
Sorting:
- Heap-based async timers☆216Updated last year
- Types and traits for http clients☆115Updated 2 years ago
- Asynchronous HTTP/1.1 in Rust☆165Updated 2 years ago
- In Rust, format Duration into a string like "1 hour ago" or "01hou".☆72Updated 3 months ago
- Async filesystem primitives☆141Updated last month
- Async tracing capabilities for the log crate☆98Updated 4 years ago
- path-tree is a lightweight high performance HTTP request router for Rust☆131Updated 5 months ago
- MIMEs in Rust☆209Updated last year
- An async parser for multipart/form-data content-type in Rust☆161Updated last year
- Copy-on-write string utilities for Rust☆158Updated last year
- Compatibility adapter between tokio and futures☆186Updated 3 months ago
- Asynchronous HTTP body trait☆151Updated last week
- An updated version of linked-hash-map and friends☆137Updated last month
- Native TLS for futures and async-std☆72Updated 6 months ago
- Async networking primitives for TCP/UDP/Unix communication☆139Updated 10 months ago
- Streamline updating a Tokio 0.1 application to Tokio 0.2.☆52Updated 4 years ago
- A sha1 implementation useable in const contexts☆88Updated last year
- Generate code in different languages from Rust type definitions for FFI interop.☆71Updated 6 years ago
- A implementation of convenience integrations between tokio and tower☆132Updated 2 years ago
- Cross-platform hostname functions in Rust☆74Updated last week
- Thread parking and unparking☆79Updated 10 months ago
- Recognizes URL patterns with support for dynamic and wildcard segments☆100Updated 3 years ago
- Common types for HTTP operations☆207Updated last year
- Async session support with plugabble backends☆126Updated 2 years ago
- Minimal non-blocking I/O for Rust☆170Updated 11 months ago
- Executor Agnostic Runtime that can run your futures with your favourite Executor☆144Updated 4 years ago
- "just open a socket"☆73Updated 2 years ago
- ☆34Updated last year
- Extended utilities for working with files and filesystems in Rust☆149Updated last year
- Serde support for querystring-style strings☆218Updated 6 months ago