JaCraig / Spidey

A multi threaded web crawler library that is generic enough to allow different engines to be swapped in.
12Updated last month

Alternatives and similar repositories for Spidey:

Users that are interested in Spidey are comparing it to the libraries listed below