nadar / crawler

A Website Crawler Implementation written in PHP. High extendible, Indexes PDFs and is very memory efficient.
10Updated 2 months ago

Alternatives and similar repositories for crawler:

Users that are interested in crawler are comparing it to the libraries listed below