pixlie / SmartCrawlerView on GitHub
A smart web crawler built in Rust that uses Claude AI to select the most relevant URLs from website sitemaps based on crawling objectives.
20Jul 9, 2025Updated 10 months ago

Alternatives and similar repositories for SmartCrawler

Users that are interested in SmartCrawler are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.

Sorting:

Are these results useful?