postmodern / spidr

A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
818Updated 3 months ago

Alternatives and similar repositories for spidr

Users that are interested in spidr are comparing it to the libraries listed below

Sorting: