postmodern / spidrLinks
A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
☆826Updated 3 months ago
Alternatives and similar repositories for spidr
Users that are interested in spidr are comparing it to the libraries listed below
Sorting:
- Ruby gem for web scraping purposes. It scrapes a given URL, and returns you its title, meta description, meta keywords, links, images...☆1,046Updated this week
- Lightweight Ruby web crawler/scraper with an elegant DSL which extracts structured data from pages.☆1,315Updated last year
- Read text and metadata from files and documents (.doc, .docx, .pages, .odt, .rtf, .pdf)☆502Updated 2 years ago
- Benchmark and profile your Rails apps☆796Updated 3 years ago
- A time-based background job scheduler daemon (just like Cron) for Rails☆686Updated 9 months ago
- Ruby library for HTML/XML transformation and sanitization☆963Updated 3 months ago
- An enterprise security extension for devise, trying to meet industrial standard security demands for web applications.☆746Updated 3 years ago
- A Rake task gem that helps you find the unused routes and controller actions for your Rails 3+ app☆904Updated 5 months ago
- Domain name parser for Ruby based on the Public Suffix List.☆639Updated this week
- A small Ruby gem to generate YouTube-like hashes from one or many numbers. Use hashids when you do not want to expose your database ids t…☆979Updated 3 months ago
- A Rubyesque interface to Gmail, with all the tools you'll need.☆410Updated last year
- Manage settings with Ruby on Rails☆1,026Updated 2 months ago
- The best data slicer! Watch a 3 minute screencast at http://tableprintgem.com☆903Updated 2 years ago
- Kimurai is a modern web scraping framework written in Ruby which works out of box with Headless Chromium/Firefox, PhantomJS, or simple HT…☆1,011Updated last year
- Usable, fast, simple HTTP 1.1 for Ruby☆1,169Updated last month
- Spreadsheet Architect is a library that allows you to create XLSX, ODS, or CSV spreadsheets super easily from ActiveRecord relations, pla…☆1,346Updated 8 months ago
- Generate strings that match a given regular expression☆523Updated last year
- Easy Diffing in Ruby☆1,292Updated 4 months ago
- Lets you find ActiveRecord + Mongoid objects by year, month, fortnight, week and more!☆1,051Updated 2 years ago
- Interact with REST services in an ActiveRecord-like manner☆905Updated 9 months ago
- ☆762Updated 5 years ago
- Log outgoing HTTP requests in ruby☆816Updated last week
- Search engine like fulltext query support for ActiveRecord☆835Updated this week
- A general classifier module to allow Bayesian and other types of classifications. A fork of cardmagic/classifier.☆555Updated last year
- DeviceDetector is a precise and fast user agent parser and device detector written in Ruby☆769Updated 2 months ago
- A wonderfully simple way to load Ruby code☆421Updated 5 years ago
- Ruby wrapper around pHash, the perceptual hash library for detecting duplicate multimedia files☆706Updated last year
- Ruby bindings for libcurl☆1,325Updated 3 weeks ago
- CSV Import for humans on Ruby / Ruby on Rails☆601Updated 2 years ago
- Ruby Optimized XML Parser☆911Updated 2 months ago