johnnagro / spider

Spider is a Web spidering library for Ruby. It handles the robots.txt, scraping, collecting, and looping so that you can just handle the data.
33Updated 4 years ago

Related projects

Alternatives and complementary repositories for spider