fcibecchini / smart-crawler

A smart distributed crawler that infers navigation models of structured websites, used to cluster pages based on their structure and extract data from them.
8Updated 3 years ago

Related projects

Alternatives and complementary repositories for smart-crawler