A loose framework for crawling and scraping web sites.
☆181Nov 4, 2015Updated 10 years ago
Alternatives and similar repositories for spidey
Users that are interested in spidey are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Implements a MongoDB back-end for Spidey (https://github.com/joeyAghion/spidey), a framework for crawling and scraping web sites.☆15Nov 4, 2015Updated 10 years ago
- A batteries-included framework for easy web-scraping. Just add CSS! (Or do more.)☆1,595Dec 26, 2018Updated 7 years ago
- Extracts machine-readable metadata and content from Web pages☆747Apr 10, 2019Updated 7 years ago
- Combine email validation and transformations to produce canonical email addresses.☆23Dec 30, 2014Updated 11 years ago
- Line up images to the edge of their container (like google images) without cropping☆164Jun 3, 2014Updated 12 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- A ticking application. The example app for "Rails 4 in Action"☆16Jun 5, 2013Updated 13 years ago
- Lightweight Ruby web crawler/scraper with an elegant DSL which extracts structured data from pages.☆1,360Apr 7, 2026Updated 6 months ago
- Anemone web-spider framework☆1,603Mar 20, 2020Updated 6 years ago
- Quick and dirty web crawling.☆273Apr 30, 2016Updated 10 years ago
- ☆15Mar 29, 2016Updated 10 years ago
- Idee PixMatch API client☆24Nov 28, 2011Updated 14 years ago
- Rails AB Testing☆17Dec 11, 2010Updated 15 years ago
- Database based asynchronously priority queue system -- Extracted from Shopify☆15Oct 25, 2010Updated 15 years ago
- Artsy API Ruby Client☆24Sep 9, 2014Updated 12 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fas…