stewartmckee / cobweb
Web crawler with very flexible crawling options. Can either use standalone or can be used with resque to perform clustered crawls.
☆226Updated 2 years ago
Alternatives and similar repositories for cobweb:
Users that are interested in cobweb are comparing it to the libraries listed below
- A quick and easy way to visually test your Rails application's API.☆727Updated 9 years ago
- PredictionIO Ruby SDK☆191Updated 6 years ago
- A gem to screencap webpages in ruby. Uses Phantom.js under the hood.☆180Updated 5 years ago
- Multi-fetch Fragments makes rendering and caching a collection of template partials easier and faster.☆539Updated 6 years ago
- Binary uuid keys in Rails☆339Updated 5 years ago
- Add group and membership functionality to your Rails models☆194Updated 6 years ago
- Polipus: distributed and scalable web-crawler framework☆92Updated 9 years ago
- Comments with threading for Rails 4 [Still works but must be replaced with https://github.com/TheComments]☆296Updated 8 years ago
- Collection of ActiveModel/ActiveRecord validators☆304Updated last year
- uniform notifier for rails logger, customized logger, javascript alert, javascript console, growl and xmpp☆237Updated 2 years ago
- Find and rank keywords in text☆205Updated 5 years ago
- carrierwave extension to use ffmpeg to transcode videos to html5-friendly format☆187Updated 7 years ago
- The gem that swaps out text with a fully-compliant Rails form in one click.☆237Updated 9 years ago
- Collection of filters that transform plain text into HTML code.☆797Updated this week
- Authorization for Rails + GUI. Semantic, Flexible, Lightweight☆768Updated last year
- ☆278Updated 5 years ago
- A set of Rack middleware and cache helpers that implement various caching strategies.☆343Updated 4 years ago
- A language detection library for Ruby that uses bloom filters for speed.☆685Updated 2 years ago
- Seamless second database integration for Rails.☆219Updated 5 months ago
- Unirest in Ruby: Simplified, lightweight HTTP client library.☆362Updated 3 years ago
- A simple and high performance tagging gem for Rails using PostgreSQL array.☆126Updated 6 months ago
- Define importers that load tabular data from spreadsheets or CSV files into any ActiveRecord-like ORM.☆330Updated 3 years ago
- Easily switch current user☆732Updated 3 years ago
- Ruby Binding for Stanford Pos-Tagger and Name Entity Recognizer☆92Updated 10 years ago
- Ruby language bindings for LIBSVM☆278Updated last year
- Download, unpack from a ZIP/TAR/GZ/BZ2 archive, parse, correct, convert units and import Google Spreadsheets, XLS, ODS, XML, CSV, HTML, e…☆302Updated 10 years ago
- Parse, validate, and format phone numbers in Ruby using Google's libphonenumber database☆549Updated 7 years ago
- Collection of text algorithms. gem install text☆584Updated 9 years ago
- ☆152Updated 7 years ago
- Devise & Omniauth Multiple Providers☆106Updated 10 years ago