postmodern / spidr
A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
☆814Updated 2 weeks ago
Alternatives and similar repositories for spidr:
Users that are interested in spidr are comparing it to the libraries listed below
- Ruby gem for web scraping purposes. It scrapes a given URL, and returns you its title, meta description, meta keywords, links, images...☆1,038Updated 8 months ago
- Anemone web-spider framework☆1,613Updated 4 years ago
- An enterprise security extension for devise, trying to meet industrial standard security demands for web applications.☆746Updated 2 years ago
- Lightweight Ruby web crawler/scraper with an elegant DSL which extracts structured data from pages.☆1,316Updated last year
- Benchmark and profile your Rails apps☆791Updated 2 years ago
- Ruby library for HTML/XML transformation and sanitization☆944Updated last week
- Spreadsheet Architect is a library that allows you to create XLSX, ODS, or CSV spreadsheets super easily from ActiveRecord relations, pla…☆1,337Updated last month
- Manage settings with Ruby on Rails☆1,014Updated last month
- Generates attr_accessors that encrypt and decrypt attributes☆2,014Updated 3 weeks ago
- Domain name parser for Ruby based on the Public Suffix List.☆627Updated this week
- Streaming downloads using Net::HTTP, http.rb or HTTPX☆1,045Updated 3 weeks ago
- Hashie is a collection of classes and mixins that make Ruby hashes more powerful.☆2,992Updated 3 weeks ago
- Enumerated attributes with I18n and ActiveRecord/Mongoid support☆1,750Updated this week
- Gruff graphing library for Ruby☆1,376Updated last month
- Ruby/ProgressBar is a text progress bar library for Ruby.☆1,571Updated 8 months ago
- A Rake task gem that helps you find the unused routes and controller actions for your Rails 3+ app☆899Updated last year
- A time-based background job scheduler daemon (just like Cron) for Rails☆687Updated 2 months ago
- Awesome rails logs☆821Updated 9 months ago
- Easy activity tracking for models - similar to Github's Public Activity☆2,971Updated 4 months ago
- Ruby Gem for convenient reading and writing of CSV files. It has intelligent defaults, and auto-discovery of column and row separators. I…☆1,485Updated 2 months ago
- Easy Diffing in Ruby☆1,268Updated 4 months ago
- Rails Plugin that tracks impressions and page views☆1,538Updated 6 months ago
- Date and time validation plugin for ActiveModel and Rails. Supports multiple ORMs and allows custom date/time formats.☆1,602Updated last month
- Per-request global storage for Rack.☆1,479Updated 9 months ago
- A small Ruby gem to generate YouTube-like hashes from one or many numbers. Use hashids when you do not want to expose your database ids t…☆975Updated last year
- A repository of geographic regions for Ruby☆1,171Updated 3 years ago
- Efficient bulk inserts with ActiveRecord☆818Updated 3 years ago
- Usable, fast, simple HTTP 1.1 for Ruby☆1,163Updated this week
- A DSL for building fun, high-performance DNS servers.☆722Updated last week
- Lets you find ActiveRecord + Mongoid objects by year, month, fortnight, week and more!☆1,053Updated 2 years ago