johnnagro / spider
Spider is a Web spidering library for Ruby. It handles the robots.txt, scraping, collecting, and looping so that you can just handle the data.
☆33Updated 4 years ago
Alternatives and similar repositories for spider:
Users that are interested in spider are comparing it to the libraries listed below
- Copy active record models from remote databases☆265Updated last year
- Redis stores for Rack::Cache☆51Updated last year
- Globalize support for FriendlyId☆66Updated 2 years ago
- Benchmark requests to tune number of workers and threads for Puma☆37Updated 4 years ago
- Polymorphic relationships in Rails that keep your database happy.☆46Updated 2 years ago
- Make any method perfomed later with ActiveJob☆28Updated last year
- Devise encryptable behavior since v2.1☆119Updated 9 months ago
- Convert strings between different cases.☆97Updated 10 months ago
- Simple, internationalized and DRY page titles and headings for Rails.☆114Updated 2 weeks ago
- StateMachines ActiveModel Integration☆33Updated 5 months ago
- Bringing together the different tableless model implementations into a single gem/plugin☆113Updated 7 years ago
- Asynchronous event publishing for Wisper using Sidekiq☆85Updated 6 months ago
- Migrate to Strong Parameters☆40Updated this week
- Additional sidekiq middleware☆92Updated 8 years ago
- A gem to incorporate the bootstrap-daterangepicker plugin into Rails 4.1+ projects☆73Updated 3 years ago
- A Ruby DSL for structured web crawling, with a robust caching system.☆255Updated 10 months ago
- Adds benchmarking methods to Sidekiq workers, keeps metrics and adds tab to Web UI to let you browse them☆145Updated 2 years ago
- Bootstrap 2 Flatly theme for RailsAdmin☆27Updated 9 years ago
- Add UID support to Devise.☆61Updated 2 years ago
- Power tools for Active Record relations (scopes)☆87Updated last week
- Execute rake tasks on remote servers (Only Capistrano 3+)☆41Updated 4 years ago
- Store nested hashes in hstores in ActiveRecord☆87Updated 4 years ago
- Tasks to deploy Sidekiq with mina.☆92Updated 2 years ago
- Interactive Ruby on Rails Routes☆66Updated 2 years ago
- Easy breadcrumbs for Ruby on Rails web applications☆51Updated 4 months ago
- active_admin_datetimepicker gem☆72Updated last year
- First gem that allows testing whenever-gem jobs☆50Updated 4 years ago
- A simple WSDL parser☆89Updated 3 months ago
- Useful extensions for active_interaction gem☆55Updated 4 months ago
- Use jsonapi-serializer with Grape☆38Updated 7 months ago