Polipus: distributed and scalable web-crawler framework
☆91Jul 20, 2015Updated 11 years ago
Alternatives and similar repositories for polipus
Users that are interested in polipus are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Web crawler with very flexible crawling options. Can either use standalone or can be used with resque to perform clustered crawls.☆224Dec 1, 2022Updated 3 years ago
- multi_markdown allows projects to use a wide variety of Markdown Processors, without having to depend on a specific one.☆19Dec 4, 2020Updated 5 years ago
- A distributed bloom filter implementation based on redis☆40Jul 26, 2018Updated 8 years ago
- Lightweight Ruby web crawler/scraper with an elegant DSL which extracts structured data from pages.☆1,359Apr 7, 2026Updated 5 months ago
- Anemone web-spider framework☆1,601Mar 20, 2020Updated 6 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- A mean little DSL'd poltergeist (capybara) based web crawler that stuffs data into your Rails app.☆21Jul 18, 2013Updated 13 years ago
- A domain name parser using public suffix list☆19Aug 23, 2024Updated 2 years ago
- A ruby reverse proxy using eventmachine.☆19Dec 21, 2017Updated 8 years ago
- - THIS IS AN OLD FORK - Checkout Medusa Crawler gem instead "medusa-crawler"☆16Aug 5, 2020Updated 6 years ago
- A Ruby implementation of Ethereum.☆266Mar 17, 2018Updated 8 years ago
- Asynchronous Web Crawler & Scraper☆142Mar 23, 2023Updated 3 years ago
- Adds support in ActiveRecord for PostgreSQL index expressions and operator classes, as well as a shorthand for case-insensitive indexes☆30Oct 4, 2019Updated 6 years ago
- Parse a date-period string and returns start and end DateTime.☆14Oct 2, 2015Updated 10 years ago
- A heap analyzer for MRI that isn't very good.☆144Aug 5, 2020Updated 6 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Easy way to retrieve Google Page Rank, Alexa Rank, index counts, and backlink counts☆273Oct 2, 2017Updated 8 years ago
- Rails engine to manage and supervise your batch jobs. Based on sidekiq.☆34May 23, 2024Updated 2 years ago
- MetaOnRails: a Rails plugin that DRYs up your page meta tags.☆28Jun 16, 2012Updated 14 years ago
- Struct with keyword arguments support☆18Jan 8, 2023Updated 3 years ago
- The Web Spider Obstacle Course☆24Dec 21, 2017Updated 8 years ago
- Digital Ocen v2 API Client☆13Oct 14, 2017Updated 8 years ago
- Fuby is a hybrid functional/object-oriented programming language on the Rubinius VM☆61Feb 13, 2014Updated 12 years ago
- Provides a backend endpoint for your frontend JavaScript application to send errors to when they’re caught☆15Apr 20, 2015Updated 11 years ago
- code analyzer tool which is extracted from rails_best_practices☆87Jan 30, 2022Updated 4 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Enhances simple I18n backend so that it inflects translations using pattern interpolation☆32Jun 17, 2022Updated 4 years ago
- Delayed Redis engine backend for Faye☆32Apr 9, 2015Updated 11 years ago
- Ruby Client Library for Taobao Open Platform☆27Dec 5, 2009Updated 16 years ago
- Ruby library for managing YAML config