A smart web crawler built in Rust that uses Claude AI to select the most relevant URLs from website sitemaps based on crawling objectives.
☆20Jul 9, 2025Updated last year
Alternatives and similar repositories for SmartCrawler
Users that are interested in SmartCrawler are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Mapping intelligence for enterprise data migrations: schema mapping, lineage, and transformation traceability that compounds across every…☆15May 7, 2026Updated 3 months ago
- The most advanced, lightweight, and undetectable C++ open-source utility client base for Minecraft. Built with ImGui and modular architec…☆25Mar 21, 2026Updated 4 months ago
- Container and workplace isolation for Claude Code and OpenClaw. Safely skip all permissions for claude.