ahkimkoo / neocrawler

Nodejs Crawler, including schedule, spider, web ui config, proxy modules. using nodejs, redis/ssdb, hbase, phantomjs. css selector extraction rules and regex extraction rules supported.
149Updated 7 years ago

Alternatives and similar repositories for neocrawler:

Users that are interested in neocrawler are comparing it to the libraries listed below