fcibecchini / smart-crawler

A smart distributed crawler that infers navigation models of structured websites, used to cluster pages based on their structure and extract data from them.
9Updated 4 years ago

Alternatives and similar repositories for smart-crawler:

Users that are interested in smart-crawler are comparing it to the libraries listed below