Alternatives and similar repositories for crawler

Users that are interested in crawler are comparing it to the libraries listed below

• ankane / camo-ruby
  Ruby client for Camo - the SSL image proxy
  ☆34Updated 10 months ago
• PigCI / App
  The PigCI Rails App. Replaced by a standalone gem.
  ☆17Updated 4 years ago
• rubycocos / feedparser
  feedparser gem - (universal) web feed parser and normalizer (XML w/ Atom or RSS, JSON Feed, HTML w/ Microformats e.g. h-entry/h-feed or F…
  ☆168Updated 9 months ago
• stve / instapaper
  Ruby Client for Instapaper's Full API
  ☆95Updated 3 years ago
• ActiveCampaign / mailhandler
  Simple lightweight mail library which allows you to send and retrieve emails, and get more details about email sending and delivery
  ☆59Updated last year
• indieweb / webmention-client-ruby
  A Ruby gem for sending and verifying Webmention notifications.
  ☆74Updated last month
• buren / ghost_blazer
  Standalone Blazer app
  ☆25Updated 2 years ago
• dwillis / feedbag
  Ruby's favorite feed auto-discovery library/tool
  ☆63Updated 9 years ago
• thoughtbot / baccano
  [no longer maintained]
  ☆71Updated 5 years ago
• bitboxer / manpages
  Gem to add man pages support to ruby gems
  ☆40Updated 4 years ago
• endymion / link-checker
  A Ruby gem for checking the links in a web site. Can either scan files or crawl pages. Multi-threaded, with red/green colored output, s…
  ☆84Updated 2 years ago
• denisdefreyne / adsf
  Web server that you can launch instantly in any directory
  ☆95Updated 3 months ago
• dnsimple / dnsimple-ruby
  The DNSimple API client for Ruby.
  ☆188Updated last month
• taskrabbit / resque-bus
  Use resque as a message bus!
  ☆127Updated 10 years ago
• puma / dev-tld-resolver
  Simple top level domain (NSSwitch hosts) resolver for linux based development Environment
  ☆49Updated 3 years ago
• codeship / dns_deploy
  Continuous Deployment for your DNS Records
  ☆51Updated 10 years ago
• adamcooke / moonrope
  A library to help with building an RPC-like JSON API
  ☆34Updated 2 years ago
• philnash / ruby-google-sheets-sinatra
  An example app using Ruby, Google Sheets and Sinatra
  ☆18Updated 2 years ago
• xeger / docker-compose
  Wrapper for docker-compose CLI with container-to-host networking helper.
  ☆34Updated last year
• callmeed / site-lab
  Website analyzer in the same vein as BuiltWith, Datanyze and NerdyData. Ruby on Rails 4. Free.
  ☆47Updated 11 years ago
• carbonfive / raygun-rails
  Rails 7 application template for Raygun, the Carbon Five Rails application generator.
  ☆52Updated 2 weeks ago
• croaky / laptop
  Setup script and dotfiles
  ☆33Updated last week
• jpmckinney / pupa-ruby
  A data scraping framework based on Open Civic Data's Pupa
  ☆67Updated 5 years ago
• citizen428 / unsavory
  Unsavory removes stale Pinboard bookmarks
  ☆24Updated last year
• ryw / pinboard
  Ruby wrapper for Pinboard API
  ☆123Updated 2 years ago
• denisdefreyne / cri
  A tool for building commandline applications
  ☆123Updated 8 months ago
• digitalocean / resource_kit
  Resource Kit provides tools to aid in making API Clients. Such as URL resolving, Request / Response layer, and more.
  ☆139Updated 2 years ago
• instructure / switchman
  ☆68Updated 3 weeks ago
• hmans / flutterby
  A flexible, Ruby-powered static site generator.
  ☆56Updated 8 years ago
• sourcerer-io / rdfs
  Distributed File Sync built in Ruby
  ☆62Updated 7 years ago