let4be / crusty-coreLinks
A small library for building fast and highly customizable web crawlers
☆16Updated 3 years ago
Alternatives and similar repositories for crusty-core
Users that are interested in crusty-core are comparing it to the libraries listed below
Sorting:
- Broad Web Crawler☆87Updated 4 years ago
- A middleware for actix-web that provides rate-limiting backed by governor.☆126Updated 4 months ago
- Rust client for txtai☆113Updated 3 weeks ago
- Spelling correction & Fuzzy search based on Symmetric Delete spelling correction algorithm.☆141Updated 7 months ago
- Dead simple queue implementation for rust with async-await☆108Updated 6 months ago
- Simple pure Rust AWS S3 Client following a Sans-IO approach☆146Updated last month
- High-level async Cassandra client written in 100% Rust.☆150Updated last month
- finalfusion embeddings in Rust☆105Updated 2 years ago
- The feature-rich, portable async channel library☆266Updated 3 years ago
- An asynchronous Redis client for Rust☆101Updated last week
- 🌿 SQL schema definition and discovery☆219Updated last month
- WebSocket implementation for both client and server☆101Updated last year
- Mix async code with CPU-heavy thread pools using Tokio + Rayon☆153Updated 3 years ago
- External sorting (i.e. on disk sorting) capability on arbitrarily sized iterator☆24Updated 10 months ago
- pgvector support for Rust☆194Updated 3 weeks ago
- Productive and safe Rust binding for leptonica and tesseract☆280Updated 2 years ago
- Helper to build an Eventsource using reqwest☆69Updated last year
- More efficient alternative to `serde_json::Value` which saves memory by interning primitive values and using tagged pointers.☆141Updated last year
- Yaque is yet another disk-backed persistent queue for Rust.☆88Updated last year
- CSV parsing in async context☆50Updated 8 months ago
- Extensible, async, cloud orientated FTP(S) server library and the core of unFTP: https://github.com/bolcom/unFTP. Follow up and talk to u…☆216Updated this week
- Rust implementation of Pruning Radix Trie, originally by Wolf Garbe☆34Updated last year
- A simple and lightweight fuzzy search engine that works in memory, searching for similar strings (a pun here).☆186Updated last month
- A simple reverse proxy for use with Hyper and Tokio☆197Updated 11 months ago
- Rust library for requesting certificates from an ACME provider☆85Updated 2 months ago
- ☆29Updated 2 years ago
- FlatBuffers compiler (flatc) as API (with focus on transparent `.fbs` to `.rs` code-generation via Cargo build scripts integration)☆133Updated 2 months ago
- Common Rust library☆52Updated 3 weeks ago
- Rust web servers without async/await.☆221Updated last year
- A suite of non-cryptographic hash functions for Rust.☆142Updated 3 years ago