A loose framework for crawling and scraping web sites.
☆181Nov 4, 2015Updated 10 years ago
Alternatives and similar repositories for spidey
Users that are interested in spidey are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Implements a MongoDB back-end for Spidey (https://github.com/joeyAghion/spidey), a framework for crawling and scraping web sites.☆15Nov 4, 2015Updated 10 years ago
- A batteries-included framework for easy web-scraping. Just add CSS! (Or do more.)☆1,594Dec 26, 2018Updated 7 years ago
- Combine email validation and transformations to produce canonical email addresses.☆23Dec 30, 2014Updated 11 years ago
- Extracts machine-readable metadata and content from Web pages☆749Apr 10, 2019Updated 7 years ago
- Line up images to the edge of their container (like google images) without cropping☆165Jun 3, 2014Updated 12 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A ticking application. The example app for "Rails 4 in Action"☆16Jun 5, 2013Updated 13 years ago
- Lightweight Ruby web crawler/scraper with an elegant DSL which extracts structured data from pages.☆1,359Apr 7, 2026Updated 5 months ago
- Quick and dirty web crawling.☆273Apr 30, 2016Updated 10 years ago
- Anemone web-spider framework☆1,601Mar 20, 2020Updated 6 years ago
- Idee PixMatch API client☆24Nov 28, 2011Updated 14 years ago
- Rails AB Testing☆17Dec 11, 2010Updated 15 years ago
- Database based asynchronously priority queue system -- Extracted from Shopify☆15Oct 25, 2010Updated 15 years ago
- A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fas…☆836Jan 12, 2026Updated 7 months ago
- Better error page for Rack apps☆6,861Jul 9, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Framework for JSON microservices☆46Feb 27, 2017Updated 9 years ago
- A resque plugin that scales heroku workers for batch jobs☆23Jul 18, 2012Updated 14 years ago
- Simple async HTTP crawler based on em-synchrony☆16Jun 1, 2012Updated 14 years ago
- Link and news sharing☆1,438Jul 16, 2014Updated 12 years ago
- A jQuery plugin to easily create sandbox environments to allow developers to see the results of specific API calls☆54Sep 9, 2011Updated 14 years ago
- The example application for Rails 4 in Action.☆38Jun 16, 2014Updated 12 years ago
- Stripe Subscription Payments with Rails☆11Nov 26, 2015Updated 10 years ago
- Ruby gem for web scraping purposes. It scrapes a given URL, and returns you its title, meta description, meta keywords, links, images...☆1,049May 14, 2026Updated 3 months ago
- Temporal: Javascript timezone detection for Rails☆82Jul 29, 2019Updated 7 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- The Front-end London website☆20May 6, 2021Updated 5 years ago
- Enables ruby encoding of postgresql copy data format for faster inserts☆23May 24, 2016Updated 10 years ago
- Light-weight, DRY as a desert, web framework for Ruby.☆274Jul 31, 2026Updated last month
- railsnew.io Nuxt app☆14Jan 26, 2023Updated 3 years ago
- Gollum wiki text editor☆30Apr 13, 2015Updated 11 years ago
- A jQuery plugin for 'locking' short content in place as the user scrolls by longer content.☆70May 25, 2014Updated 12 years ago
- Rum based microframework for web development.☆1,445Jan 24, 2024Updated 2 years ago
- A small demo project for introducing terraform☆10Dec 2, 2017Updated 8 years ago
- React forms made simple☆14Aug 3, 2016Updated 10 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Doing Analytics in Ruby.☆157Jan 6, 2014Updated 12 years ago
- Easily create REST APIs☆517May 5, 2023Updated 3 years ago
- ☆15Mar 29, 2016Updated 10 years ago
- A jQuery plugin to listen for a user entering the konami code.☆31Jun 18, 2018Updated 8 years ago
- Automatically parse and tabulate Nessus findings into OpenDocument tables☆12Dec 15, 2015Updated 10 years ago
- A middleman project template for an HTML ebook or a documentation site that needs runnable examples.☆25Apr 13, 2014Updated 12 years ago
- Advanced email processing solution for Ruby on Rails applications☆573Jan 18, 2023Updated 3 years ago