hominee / dyer
Dyer is designed for reliable, flexible and fast web crawling, providing some high-level, comprehensive features without compromising speed.
β127Updated 2 years ago
Alternatives and similar repositories for dyer:
Users that are interested in dyer are comparing it to the libraries listed below
- π³ A tiny skiplist based log-structured merge-tree written in Rust.β25Updated last year
- A highly extensible runner that can execute any workflow.β18Updated 9 months ago
- Free Palestineπ΅πΈπ΅πΈπ΅πΈSuper fast Rust library to get image size and format without loading/decoding. Support avif, bmp, cur, dds, gifβ¦β69Updated 4 months ago
- eraft-rs is raft component of etcd-rsβ65Updated 2 years ago
- MCP server for Apache Icebergβ27Updated last week
- An expression engine written in pure rustβ33Updated last year
- Flock: A Low-Cost Streaming Query Engine on FaaS Platformsβ270Updated last year
- Provides json/csv/protobuf/arrow streaming support for axumβ74Updated last week
- Async synchronization primitivesβ267Updated 3 weeks ago
- A KV-database with 'Git-like' featuresβ23Updated this week
- β113Updated 2 years ago
- Broad Web Crawlerβ85Updated 3 years ago
- A benchmarking harness for concurrent key-value collectionsβ118Updated 2 years ago
- Utility wrapper to send non send types to other threads safelyβ179Updated last month
- SIMD-accelerated operationsβ221Updated 2 months ago
- A pure Rust database implementation using an append-only B-Tree file format.β268Updated last year
- ReefDB is a minimalistic, in-memory and on-disk database management system written in Rust, implementing basic SQL query capabilities andβ¦β87Updated 3 months ago
- Semantic wrapper for byte count representationsβ133Updated 3 weeks ago
- A comprehensive GitHub REST API library based on Rust.β27Updated 2 months ago
- Auto-generate serde implementations for prost typesβ94Updated 9 months ago
- RiteLinked - LinkedHashMap & LinkedHashSet in Rustβ53Updated last month
- The feature-rich, portable async channel libraryβ254Updated 2 years ago
- β΄οΈ An experimental graph databaseβ112Updated last year
- path-tree is a lightweight high performance HTTP request router for Rustβ130Updated this week
- An embedded key/value store for Rustβ166Updated 2 years ago
- Minimalist scheduling library for Rustβ42Updated 2 years ago
- A k8s operator in rust that convert remote secrets into k8s secretsβ71Updated last week
- A flexible and convenient high-level mmap for zero-copy file I/O.β111Updated 2 months ago
- A global executor built on top of async-executor and smolβ74Updated last month
- Rust crate for printing tables on command line.β124Updated last month