schollz / crawdadLinks
Cross-platform persistent and distributed web crawler
☆64Updated 6 years ago
Alternatives and similar repositories for crawdad
Users that are interested in crawdad are comparing it to the libraries listed below
Sorting:
- Simple, lightweight, api-driven log aggregation service with realtime push capabilities and historical persistence.☆71Updated 6 years ago
- Serve millions of JSON documents via HTTP.☆70Updated last year
- The speed of a native map, the safety of sync.RWMutex and the durability of bbolt☆24Updated 5 years ago
- An alternative to traditional task schedulers☆96Updated 8 years ago
- Easily move things between computers with a code phrase and https://cowyo.com☆63Updated 6 years ago
- Backup your file to your remote server using minimum bandwidth.☆23Updated 7 years ago
- GitHub Webhooks Made Easy!☆32Updated last month
- Cross-platform persistent and distributed web crawler☆113Updated 8 years ago
- Browse Elasticsearch like a filesystem.☆28Updated 9 years ago
- Pluck text in a fast and intuitive way☆215Updated 6 years ago
- Dead simple one-page PDF invoice generator. Write YAML, get simple, pretty invoices.☆87Updated 4 years ago
- A multicore csv reader library in Go☆47Updated last year
- Easy .ovpn files import/generation tool☆29Updated 5 years ago
- Open Source Log, Exception, Metrics management.☆15Updated 8 years ago
- A cross-platform network-wide ad/site blocker with a simple web control panel.☆149Updated 2 years ago
- Super simple, concurrent worker queue in golang☆68Updated 6 years ago
- Fast message store, written in Go☆28Updated 3 weeks ago
- Simple KV HTTP API for Minio / S3 - store JSON documents or binary blobs☆84Updated 6 years ago
- HTTP load balancer and cache☆37Updated last year
- A simple tool to collect and process quite a few web news from multiple sources☆36Updated 3 years ago
- A minimalist, easy to deploy, dependency free file server written in go☆55Updated 6 years ago
- A standalone lightweight full-text search engine built on top of blevesearch and Go with multiple storage (scorch, boltdb, leveldb, badge…☆161Updated 7 years ago
- Miscellaneous tools for processing WARC files from the CommonCrawl☆24Updated 12 years ago
- Audio feed generator and CMS☆72Updated 3 years ago
- tmpl is a lightweight, shell focused, swiss army knife for document template processing☆40Updated 4 years ago
- Difference hash of images☆19Updated last year
- Automatically discover peers and synchronize a folder☆38Updated 5 years ago
- Basic web server framework with HTTP/2 and Let's Encrypt.☆76Updated 3 years ago
- A cross-platform tool for data pipelines.☆95Updated 5 years ago
- [mirror] Library and program to parse and forward HAProxy HTTP logs☆22Updated last week