Polipus: distributed and scalable web-crawler framework
☆91Jul 20, 2015Updated 11 years ago
Alternatives and similar repositories for polipus
Users that are interested in polipus are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Web crawler with very flexible crawling options. Can either use standalone or can be used with resque to perform clustered crawls.☆224Dec 1, 2022Updated 3 years ago
- multi_markdown allows projects to use a wide variety of Markdown Processors, without having to depend on a specific one.☆19Dec 4, 2020Updated 5 years ago
- A distributed bloom filter implementation based on redis☆40Jul 26, 2018Updated 8 years ago
- Lightweight Ruby web crawler/scraper with an elegant DSL which extracts structured data from pages.☆1,362Apr 7, 2026Updated 3 months ago
- Anemone web-spider framework☆1,602Mar 20, 2020Updated 6 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A mean little DSL'd poltergeist (capybara) based web crawler that stuffs data into your Rails app.☆21Jul 18, 2013Updated 13 years ago
- A domain name parser using public suffix list☆19Aug 23, 2024Updated last year
- A ruby reverse proxy using eventmachine.☆19Dec 21, 2017Updated 8 years ago
- Ruby binding to the Xiaonei API☆56May 13, 2010Updated 16 years ago
- A Ruby implementation of Ethereum.☆267Mar 17, 2018Updated 8 years ago
- Asynchronous Web Crawler & Scraper☆143Mar 23, 2023Updated 3 years ago
- Adds support in ActiveRecord for PostgreSQL index expressions and operator classes, as well as a shorthand for case-insensitive indexes☆30Oct 4, 2019Updated 6 years ago
- Parse a date-period string and returns start and end DateTime.☆14Oct 2, 2015Updated 10 years ago
- A heap analyzer for MRI that isn't very good.☆144Aug 5, 2020Updated 5 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Easy way to retrieve Google Page Rank, Alexa Rank, index counts, and backlink counts☆273Oct 2, 2017Updated 8 years ago
- Rails engine to manage and supervise your batch jobs. Based on sidekiq.☆34May 23, 2024Updated 2 years ago
- MetaOnRails: a Rails plugin that DRYs up your page meta tags.☆28Jun 16, 2012Updated 14 years ago
- A gamification gem to Ruby on Rails applications☆302Jan 18, 2023Updated 3 years ago
- Struct with keyword arguments support☆18Jan 8, 2023Updated 3 years ago
- The Web Spider Obstacle Course☆24Dec 21, 2017Updated 8 years ago
- Digital Ocen v2 API Client☆13Oct 14, 2017Updated 8 years ago
- Fuby is a hybrid functional/object-oriented programming language on the Rubinius VM☆61Feb 13, 2014Updated 12 years ago
- Provides a backend endpoint for your frontend JavaScript application to send errors to when they’re caught☆15Apr 20, 2015Updated 11 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- code analyzer tool which is extracted from rails_best_practices☆87Jan 30, 2022Updated 4 years ago
- Enhances simple I18n backend so that it inflects translations using pattern interpolation☆32Jun 17, 2022Updated 4 years ago
- Delayed Redis engine backend for Faye☆32Apr 9, 2015Updated 11 years ago
- Ruby Client Library for Taobao Open Platform☆27Dec 5, 2009Updated 16 years ago
- Ruby library for managing YAML config☆17Sep 28, 2023Updated 2 years ago
- Google Dictionary for Mac☆20Aug 3, 2011Updated 14 years ago
- Priority Queue in Elixir☆14Feb 6, 2016Updated 10 years ago
- A batteries-included framework for easy web-scraping. Just add CSS! (Or do more.)☆1,598Dec 26, 2018Updated 7 years ago
- Chef kitchen for setting up servers for use with a rails stack☆93Sep 9, 2015Updated 10 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- RubyConf 2011 Notes☆12Jun 22, 2012Updated 14 years ago
- 🚫 DEPRECATED - Use https://github.com/GoogleCloudPlatform/google-cloud-ruby☆59Jul 19, 2010Updated 16 years ago
- ActiveAdmin plugin for adding Excel (xls) download links for your resources☆21Dec 18, 2023Updated 2 years ago
- Conditional UI predicates for Rails☆36Mar 19, 2013Updated 13 years ago
- A Rack middleware to authorize api access☆22Jun 29, 2015Updated 11 years ago
- This is a GitHub hosted version of the Ruby lingua library.☆39Feb 27, 2018Updated 8 years ago
- Experimental Distributed Web Crawling with Python + Gearman☆22May 2, 2012Updated 14 years ago