stewartmckee / cobwebLinks
Web crawler with very flexible crawling options. Can either use standalone or can be used with resque to perform clustered crawls.
☆226Updated 2 years ago
Alternatives and similar repositories for cobweb
Users that are interested in cobweb are comparing it to the libraries listed below
Sorting:
- A quick and easy way to visually test your Rails application's API.☆726Updated 10 years ago
- PredictionIO Ruby SDK☆190Updated 6 years ago
- Tor-privoxy is a Ruby Mechanize wrapper to access the web with mechanize via Tor/Privoxy It allows to use multiple Privoxy instances, swi…☆84Updated 8 years ago
- Multi-fetch Fragments makes rendering and caching a collection of template partials easier and faster.☆539Updated 7 years ago
- Collection of ActiveModel/ActiveRecord validators☆303Updated last year
- Modular, extensible open-source ecommerce solution for Ruby on Rails. No longer under development.☆271Updated 6 years ago
- Collection of filters that transform plain text into HTML code.☆797Updated 3 weeks ago
- Show ActiveAdmin index as a nested tree with drag'n'drop☆162Updated last year
- Download, unpack from a ZIP/TAR/GZ/BZ2 archive, parse, correct, convert units and import Google Spreadsheets, XLS, ODS, XML, CSV, HTML, e…☆306Updated 11 years ago
- Polipus: distributed and scalable web-crawler framework☆92Updated 9 years ago
- Binary uuid keys in Rails☆339Updated 5 years ago
- Write Through and Read Through caching library inspired by CacheMoney and cache_fu, support ActiveRecord 4, 5 and 6.☆394Updated 3 years ago
- A simple login and password strategy for OmniAuth.☆349Updated this week
- store rails views on database instead of filesystem☆172Updated last year
- A set of Rack middleware and cache helpers that implement various caching strategies.☆343Updated 5 years ago
- Unirest in Ruby: Simplified, lightweight HTTP client library.☆364Updated last month
- Find and rank keywords in text☆207Updated 5 years ago
- Expose libstemmer_c to Ruby☆250Updated 3 years ago
- ☆152Updated 8 years ago
- Collection of text algorithms. gem install text☆584Updated 10 years ago
- Track notable requests and background jobs☆443Updated last month
- Seamless second database integration for Rails.☆219Updated 8 months ago
- Ruby bindings to the OpenNLP Java toolkit.☆91Updated 2 weeks ago
- Ruby Money::Bank interface for the Google Currency exchange data☆182Updated 4 years ago
- Simple Rails glue for the Faye messaging protocol.☆433Updated 9 years ago
- Multi-user non-linear history tracking, auditing, undo, redo for mongoid.☆395Updated 9 months ago
- Voight-Kampff is a Ruby gem that detects bots, spiders, crawlers and replicants☆189Updated last year
- Static page caching for Action Pack (removed from core in Rails 4.0)☆355Updated 4 years ago
- Add group and membership functionality to your Rails models☆194Updated 6 years ago
- Rack middleware for rate-limiting incoming HTTP requests configured to be used with Redis.☆274Updated 4 years ago