scrapinghub / aduanaLinks

Frontera backend to guide a crawl using PageRank, HITS or other ranking algorithms based on the link structure of the web graph, even when making big crawls (one billion pages).
55Updated last year

Alternatives and similar repositories for aduana

Users that are interested in aduana are comparing it to the libraries listed below

Sorting: