CrawlScript / WebCollector

WebCollector is an open source web crawler framework based on Java.It provides some simple interfaces for crawling the Web,you can setup a multi-threaded web crawler in less than 5 minutes.
3,071Updated 8 months ago

Alternatives and similar repositories for WebCollector:

Users that are interested in WebCollector are comparing it to the libraries listed below