A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
☆836Jan 12, 2026Updated 9 months ago
Alternatives and similar repositories for spidr
Users that are interested in spidr are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Lightweight Ruby web crawler/scraper with an elegant DSL which extracts structured data from pages.☆1,360Oct 27, 2026Updated last week
- Anemone web-spider framework☆1,603Mar 20, 2020Updated 6 years ago
- Mechanize is a ruby library that makes automated web interaction easy.☆4,445Oct 26, 2026Updated last week
- Web crawler with very flexible crawling options. Can either use standalone or can be used with resque to perform clustered crawls.☆224Dec 1, 2022Updated 3 years ago
- Ruby: parallel processing made simple and fast☆4,269Oct 5, 2026Updated last month
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- HTTP (The Gem! a.k.a. http.rb) - a fast Ruby HTTP client with a chainable API, streaming support, and timeouts☆3,083Updated this week
- Fast high-level web crawling Ruby framework☆728Updated this week
- Typhoeus wraps libcurl in order to make fast and reliable requests.☆4,138Oct 30, 2026Updated last week
- Headless Chrome Ruby API☆2,071Updated this week
- Ruby gem for web scraping purposes. It scrapes a given URL, and returns you its title, meta description, meta keywords, links, images...☆1,050Updated this week
- File Attachment toolkit for Ruby applications☆3,286Updated this week
- A micro library providing Ruby objects with Publish-Subscribe capabilities☆3,332Aug 15, 2024Updated 2 years ago
- The simplest way to group temporal data☆3,886Oct 25, 2026Updated last week
- An opinionated framework for creating REST-like APIs in Ruby.☆10,006Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Modern concurrency tools including agents, futures, promises, thread pools, supervisors, and more. Inspired by Erlang, Clojure, Scala, Go…☆5,836Oct 16, 2026Updated 3 weeks ago
- Rack middleware for blocking & throttling☆5,767Sep 8, 2026Updated last month
- Simple, powerful, first-party analytics for Rails☆4,483Oct 22, 2026Updated 2 weeks ago
- A high-performance web server for Ruby, supporting HTTP/1, HTTP/2 and TLS.☆3,055Updated this week
- Streaming downloads using Net::HTTP, http.rb or HTTPX☆1,065Updated this week
- Sequel: The Database Toolkit for Ruby☆5,101Updated this week
- Ruby on SQLite☆309Oct 16, 2026Updated 3 weeks ago
- 🍯 Unobtrusive and flexible spam protection for Rails apps☆1,253Jul 15, 2026Updated 3 months ago
- Hashie is a collection of classes and mixins that make Ruby hashes more powerful.☆3,037Oct 26, 2026Updated last week
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Minimal authorization through OO design and pure Ruby classes☆8,519Oct 16, 2026Updated 3 weeks ago
- Cron jobs in Ruby☆8,853Oct 21, 2026Updated 2 weeks ago
- a minimal, fast, safe sql executor☆400Sep 17, 2024Updated 2 years ago
- Simple, but flexible HTTP client library, with support for multiple backends.☆5,955Updated this week
- A Ruby library and CLI for generating and working with wordlists.☆50Jan 12, 2026Updated 9 months ago
- Create beautiful JavaScript charts with one line of Ruby☆6,526Oct 22, 2026Updated 2 weeks ago
- Track changes to your rails models☆7,028Sep 25, 2026Updated last month
- A Ruby interface to nmap, the exploration tool and security / port scanner. Allows automating nmap and parsing nmap XML files.☆297Jan 12, 2026Updated 9 months ago
- Data processing & ETL framework for Ruby☆1,776Jan 10, 2026Updated 9 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- FriendlyId is the “Swiss Army bulldozer” of slugging and permalink plugins for ActiveRecord. It allows you to create pretty URL’s and wor…☆6,222Aug 18, 2026Updated 2 months ago
- Natural language processing framework for Ruby.☆1,367May 16, 2025Updated last year
- Easy activity tracking for models - similar to Github's Public Activity☆2,989Jun 8, 2026Updated 4 months ago
- An attempt to tame Rails' default policy to log everything.☆3,573Sep 29, 2026Updated last month
- [DISCONTINUED ] Attributes on Steroids for Plain Old Ruby Objects☆3,745Aug 10, 2021Updated 5 years ago
- Code smell detector for Ruby☆4,138Oct 17, 2026Updated 3 weeks ago
- Actor-based concurrent object framework for Ruby☆3,866Mar 7, 2024Updated 2 years ago