let4be / crusty-coreLinks
A small library for building fast and highly customizable web crawlers
☆16Updated 2 years ago
Alternatives and similar repositories for crusty-core
Users that are interested in crusty-core are comparing it to the libraries listed below
Sorting:
- Broad Web Crawler☆86Updated 3 years ago
- ☆40Updated 2 months ago
- Yaque is yet another disk-backed persistent queue for Rust.☆84Updated last year
- Structured data serialization library☆21Updated 11 months ago
- Rust client for sonic search backend☆41Updated 2 years ago
- A concurrent, append-only vector.☆165Updated 3 weeks ago
- ☆17Updated 2 months ago
- WebSocket connections for axum directly using tungstenite☆24Updated last year
- Common Rust library☆36Updated this week
- A middleware for actix-web that provides rate-limiting backed by governor.☆111Updated last week
- r-cache is an in memory key value store. It is thread safe and values can have expiry times.☆21Updated 2 years ago
- Mix async code with CPU-heavy thread pools using Tokio + Rayon☆140Updated 2 years ago
- ☆43Updated last month
- SegVec data structure for rust. Similar to Vec, but allocates memory in chunks of increasing size.☆38Updated last year
- A fast mpmc queue with broadcast capabilities. Known as multiqueue too.☆56Updated 3 years ago
- Thread-safe clone-on-write container for fast concurrent writing and reading.☆49Updated 2 years ago
- Rust B-Tree map for pub/sub services☆37Updated 3 months ago
- A timeout connector for the hyper client☆26Updated 7 months ago
- Distributed systems library for making communications through the network easier, while keeping minimalism and flexibility.☆34Updated 2 years ago
- A full asyncronous Rust ORM and query builder for multiple databases☆108Updated this week
- Drpc-Correct, high performance, robust, easy use Remote invocation framework☆38Updated last year
- CSRF (Cross-Site Request Forgery) protection for Axum☆32Updated 5 months ago
- Dead simple queue implementation for rust with async-await☆99Updated last year
- An async RPC in rust-lang that mimics golang's net/rpc☆31Updated last year
- Async, lock-free synchronization primitives for task wakeup☆45Updated 8 months ago
- A websocket protocol implementation.☆93Updated 2 months ago
- CSV parsing in async context☆44Updated 3 weeks ago
- More efficient alternative to `serde_json::Value` which saves memory by interning primitive values and using tagged pointers.☆136Updated 6 months ago
- Casbin Actix-web access control middleware☆57Updated last year
- A lockless mpmc/mpsc to support async base on crossbeam☆48Updated last year