nadar / crawler

A Website Crawler Implementation written in PHP. High extendible, Indexes PDFs and is very memory efficient.
β˜†10Updated this week

Related projects β“˜

Alternatives and complementary repositories for crawler