scrapinghub / aduana

Frontera backend to guide a crawl using PageRank, HITS or other ranking algorithms based on the link structure of the web graph, even when making big crawls (one billion pages).
55Updated 10 months ago

Alternatives and similar repositories for aduana:

Users that are interested in aduana are comparing it to the libraries listed below