stewartmckee / cobweb
Web crawler with very flexible crawling options. Can either use standalone or can be used with resque to perform clustered crawls.
☆226Updated 2 years ago
Alternatives and similar repositories for cobweb
Users that are interested in cobweb are comparing it to the libraries listed below
Sorting:
- PredictionIO Ruby SDK☆190Updated 6 years ago
- A quick and easy way to visually test your Rails application's API.☆727Updated 10 years ago
- Collection of filters that transform plain text into HTML code.☆798Updated this week
- Expose libstemmer_c to Ruby☆250Updated 3 years ago
- Collection of text algorithms. gem install text☆584Updated 10 years ago
- Multi-fetch Fragments makes rendering and caching a collection of template partials easier and faster.☆539Updated 6 years ago
- A gem to screencap webpages in ruby. Uses Phantom.js under the hood.☆180Updated 5 years ago
- Binary uuid keys in Rails☆339Updated 5 years ago
- Rails event sourcing with RabbitMQ☆100Updated 10 years ago
- Comments with threading for Rails 4 [Still works but must be replaced with https://github.com/TheComments]☆295Updated 9 years ago
- Polipus: distributed and scalable web-crawler framework☆92Updated 9 years ago
- Unirest in Ruby: Simplified, lightweight HTTP client library.☆364Updated last month
- A set of Rack middleware and cache helpers that implement various caching strategies.☆343Updated 4 years ago
- Adds support for missing PostgreSQL data types to ActiveRecord☆641Updated 3 years ago
- ActiveWarehouse for Rails - Implement data warehouses with Rails☆196Updated 10 years ago
- Rack middleware for rate-limiting incoming HTTP requests configured to be used with Redis.☆274Updated 4 years ago
- Download, unpack from a ZIP/TAR/GZ/BZ2 archive, parse, correct, convert units and import Google Spreadsheets, XLS, ODS, XML, CSV, HTML, e…☆306Updated 11 years ago
- Parse, validate, and format phone numbers in Ruby using Google's libphonenumber database☆548Updated 7 years ago
- A mountable Rails blogging engine☆240Updated 2 years ago
- A Ruby natural language processor.☆162Updated 3 years ago
- Plugin for Mina that adds support for multiple stages.☆110Updated last year
- Show ActiveAdmin index as a nested tree with drag'n'drop☆162Updated last year
- Simple colored logging for rails 4 and 5 apps☆69Updated 6 years ago
- Find a lot of kinds of common information in a string. CommonRegex port for Ruby☆80Updated 3 years ago
- Collection of ActiveModel/ActiveRecord validators☆304Updated last year
- Create simple or complex workflows and rock your app!☆151Updated 9 years ago
- Devise & Omniauth Multiple Providers☆106Updated 10 years ago
- Authorization for Rails + GUI. Semantic, Flexible, Lightweight☆766Updated last year
- Seamless second database integration for Rails.☆219Updated 8 months ago
- An easy extension for Paperclip to crop your image uploads using jCrop.☆203Updated 8 years ago