postmodern / spidr
A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
☆812Updated last month
Alternatives and similar repositories for spidr:
Users that are interested in spidr are comparing it to the libraries listed below
- Ruby gem for web scraping purposes. It scrapes a given URL, and returns you its title, meta description, meta keywords, links, images...☆1,039Updated 7 months ago
- Anemone web-spider framework☆1,611Updated 4 years ago
- Interact with REST services in an ActiveRecord-like manner☆900Updated 2 weeks ago
- Generates attr_accessors that encrypt and decrypt attributes☆2,009Updated this week
- An enterprise security extension for devise, trying to meet industrial standard security demands for web applications.☆748Updated 2 years ago
- Spreadsheet Architect is a library that allows you to create XLSX, ODS, or CSV spreadsheets super easily from ActiveRecord relations, pla…☆1,335Updated last week
- Ruby library for HTML/XML transformation and sanitization☆937Updated 2 weeks ago
- Manage settings with Ruby on Rails☆1,012Updated 3 weeks ago
- Hashie is a collection of classes and mixins that make Ruby hashes more powerful.☆2,990Updated 2 weeks ago
- Ruby Facets☆800Updated last year
- Ruby Gem for convenient reading and writing of CSV files. It has intelligent defaults, and auto-discovery of column and row separators. I…☆1,482Updated 3 weeks ago
- A Rake task gem that helps you find the unused routes and controller actions for your Rails 3+ app☆900Updated last year
- A small Ruby gem to generate YouTube-like hashes from one or many numbers. Use hashids when you do not want to expose your database ids t…☆973Updated last year
- Lightweight Ruby web crawler/scraper with an elegant DSL which extracts structured data from pages.☆1,316Updated 11 months ago
- Usable, fast, simple HTTP 1.1 for Ruby☆1,163Updated 2 weeks ago
- A plugin for versioning Rails based RESTful APIs.☆971Updated 10 months ago
- A time-based background job scheduler daemon (just like Cron) for Rails☆687Updated last month
- Streaming downloads using Net::HTTP, http.rb or HTTPX☆1,041Updated 8 months ago
- Oga is an XML/HTML parser written in Ruby.☆1,168Updated last year
- Abort requests that are taking too long☆881Updated 5 months ago
- Lets you find ActiveRecord + Mongoid objects by year, month, fortnight, week and more!☆1,052Updated 2 years ago
- Benchmark and profile your Rails apps☆788Updated 2 years ago
- Squasher - squash your old migrations in a single command☆1,503Updated last month
- Simplify receiving email in Rails (deprecated)☆1,375Updated 6 months ago
- Kimurai is a modern web scraping framework written in Ruby which works out of box with Headless Chromium/Firefox, PhantomJS, or simple HT…☆1,013Updated 7 months ago
- Efficient bulk inserts with ActiveRecord☆818Updated 3 years ago
- High Performance Haml Implementation☆981Updated last year
- Add OAPI/swagger v2.0 compliant documentation to your grape API☆1,089Updated last week
- Domain name parser for Ruby based on the Public Suffix List.☆623Updated this week