jstrosch / subcrawl

SubCrawl is a modular framework for discovering open directories, identifying unique content through signatures and organizing the data with optional output modules, such as Elastic.
49Updated 5 months ago

Related projects

Alternatives and complementary repositories for subcrawl