Polipus: distributed and scalable web-crawler framework
☆92Jul 20, 2015Updated 10 years ago
Alternatives and similar repositories for polipus
Users that are interested in polipus are comparing it to the libraries listed below
Sorting:
- Fast Ruby FFI k-d tree with support for latitude/longitude and geo distance range search☆46Feb 25, 2013Updated 13 years ago
- Rails engine to manage and supervise your batch jobs. Based on sidekiq.☆34May 23, 2024Updated last year
- Publish-Subscribe Component w/ XMPP, REST, and Ad-hoc interfaces☆27Jun 28, 2011Updated 14 years ago
- Asynchronous Web Crawler & Scraper☆143Mar 23, 2023Updated 2 years ago
- A platform for tools that do stuff with data☆56Feb 14, 2019Updated 7 years ago
- Slinky, a high-performance web crawler / text analytics in Python, Redis, Hadoop, R, Gephi☆41Aug 30, 2010Updated 15 years ago
- Front-end mission control for Gush☆19Jan 22, 2019Updated 7 years ago
- Smarter publish/subscribe☆23Dec 11, 2015Updated 10 years ago
- This Rails plugin is the easiest way to export to Excel. It gives you the ability to call to_xls to a collection of activerecords. The bu…☆140May 30, 2015Updated 10 years ago
- ActiveAdmin plugin for adding Excel (xls) download links for your resources☆21Dec 18, 2023Updated 2 years ago
- Provides an interface to SEOmoz's suite of APIs, including the free and site intelligence APIs.☆38Jun 9, 2015Updated 10 years ago
- Create and validate Data Packages in the browser☆27Dec 20, 2021Updated 4 years ago
- Convert URL's to a normalized unicode format☆67Feb 8, 2018Updated 8 years ago
- Need to access a WordPress site's data from Ruby? ruby-wpdb to the rescue!☆89Jun 1, 2015Updated 10 years ago
- A Hybrid Social Mobile App Developed using MeteorJs & Framework7☆22Feb 10, 2015Updated 11 years ago
- A Rack middleware to authorize api access☆22Jun 29, 2015Updated 10 years ago
- Adds support in ActiveRecord for PostgreSQL index expressions and operator classes, as well as a shorthand for case-insensitive indexes☆30Oct 4, 2019Updated 6 years ago
- ☆29Jul 22, 2016Updated 9 years ago
- Lightweight Ruby web crawler/scraper with an elegant DSL which extracts structured data from pages.☆1,355Nov 27, 2025Updated 3 months ago
- 微信公众平台 开放消息接口 Rack Middleware☆105Mar 6, 2014Updated 12 years ago
- Natural language parser for recurring events☆147Sep 6, 2013Updated 12 years ago
- Cloud Mining automatically builds exploratory faceted search systems.☆52Oct 15, 2013Updated 12 years ago
- The goal of this experiment is to take articles and certain metadata and group them by topic.☆11Apr 14, 2016Updated 9 years ago
- newrelic instrument for grape☆117Mar 9, 2017Updated 8 years ago
- A batteries-included framework for easy web-scraping. Just add CSS! (Or do more.)☆1,600Dec 26, 2018Updated 7 years ago
- Geographic Place, Date/time, and Pattern entity extraction toolkit along with text extraction from unstructured data and GIS outputters.☆46Jan 28, 2026Updated last month
- Text classifier in Ruby that uses Hadoop/HBase, Mongo, or Cassandra for storage. New location for http://github.com/livingsocial/ankusa☆100Nov 22, 2015Updated 10 years ago
- An open-source news aggregator☆15Sep 9, 2016Updated 9 years ago
- Remove scheduled jobs easily☆10Apr 28, 2020Updated 5 years ago
- A simple library that makes it easy to create drip marketing campaigns (or anything that should be performed on an offset schedule)☆30Aug 23, 2013Updated 12 years ago
- 豆瓣电影评论可视化☆10May 19, 2016Updated 9 years ago
- Digitization information system build on top of Fedora repository☆16Jan 15, 2019Updated 7 years ago
- a Ruby library for Microsoft's Bing search API☆28Nov 5, 2009Updated 16 years ago
- ApertureDB Python Client☆12Jan 14, 2026Updated last month
- Focused Crawler for VT's CTRNet☆10May 13, 2013Updated 12 years ago
- The Smart Contract of the LOC tokensale☆11Sep 23, 2017Updated 8 years ago
- ☆12Oct 25, 2015Updated 10 years ago
- Designed to help lawyers and legal professionals find precedent fast and prepare for case negotiations by simulating trajectories☆10Oct 16, 2024Updated last year
- Transparent object persistence for Ruby☆76Jun 21, 2016Updated 9 years ago