fcibecchini / smart-crawler

A smart distributed crawler that infers navigation models of structured websites, used to cluster pages based on their structure and extract data from them.
8Updated 3 years ago

Alternatives and similar repositories for smart-crawler:

Users that are interested in smart-crawler are comparing it to the libraries listed below