A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
☆835Jan 12, 2026Updated 7 months ago
Alternatives and similar repositories for spidr
Users that are interested in spidr are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Lightweight Ruby web crawler/scraper with an elegant DSL which extracts structured data from pages.☆1,361Apr 7, 2026Updated 4 months ago
- Anemone web-spider framework☆1,600Mar 20, 2020Updated 6 years ago
- Mechanize is a ruby library that makes automated web interaction easy.☆4,440May 10, 2026Updated 3 months ago
- Web crawler with very flexible crawling options. Can either use standalone or can be used with resque to perform clustered crawls.☆224Dec 1, 2022Updated 3 years ago
- Ruby: parallel processing made simple and fast☆4,265May 15, 2026Updated 3 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Typhoeus wraps libcurl in order to make fast and reliable requests.☆4,135Mar 10, 2026Updated 5 months ago
- Fast high-level web crawling Ruby framework☆685Jul 3, 2024Updated 2 years ago
- Write web scrapers in Ruby using a clean, AI-assisted DSL. Kimurai uses AI to figure out where the data lives, then caches the selectors …☆1,103Jan 27, 2026Updated 6 months ago
- Ruby gem for web scraping purposes. It scrapes a given URL, and returns you its title, meta description, meta keywords, links, images...☆1,049May 14, 2026Updated 3 months ago
- Ruby on SQLite☆291Jul 21, 2026Updated 3 weeks ago
- A micro library providing Ruby objects with Publish-Subscribe capabilities☆3,332Aug 15, 2024Updated 2 years ago
- The simplest way to group temporal data☆3,887Updated this week
- Headless Chrome Ruby API☆2,036Updated this week
- Rack middleware for blocking & throttling☆5,762Jul 2, 2026Updated last month
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- File Attachment toolkit for Ruby applications☆3,286Jul 13, 2026Updated last month
- An opinionated framework for creating REST-like APIs in Ruby.☆9,994Aug 9, 2026Updated last week
- HTTP (The Gem! a.k.a. http.rb) - a fast Ruby HTTP client with a chainable API, streaming support, and timeouts☆3,086Jul 14, 2026Updated last month
- Sequel: The Database Toolkit for Ruby☆5,092Updated this week
- Hashie is a collection of classes and mixins that make Ruby hashes more powerful.☆3,039Jun 22, 2026Updated last month
- Streaming downloads using Net::HTTP, http.rb or HTTPX☆1,062May 6, 2026Updated 3 months ago
- Minimal authorization through OO design and pure Ruby classes☆8,520Aug 2, 2026Updated 2 weeks ago
- Cron jobs in Ruby☆8,862Jul 1, 2026Updated last month
- Simple, but flexible HTTP client library, with support for multiple backends.☆5,949Updated this week
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Create beautiful JavaScript charts with one line of Ruby☆6,528Updated this week
- Track changes to your rails models☆7,029May 8, 2026Updated 3 months ago
- 🍯 Unobtrusive and flexible spam protection for Rails apps☆1,250Jul 15, 2026Updated last month
- Data processing & ETL framework for Ruby☆1,775Jan 10, 2026Updated 7 months ago
- Natural language processing framework for Ruby.☆1,367May 16, 2025Updated last year
- [DISCONTINUED ] Attributes on Steroids for Plain Old Ruby Objects☆3,745Aug 10, 2021Updated 5 years ago
- FriendlyId is the “Swiss Army bulldozer” of slugging and permalink plugins for ActiveRecord. It allows you to create pretty URL’s and wor…☆6,226Updated this week
- An attempt to tame Rails' default policy to log everything.☆3,574Jul 8, 2026Updated last month
- Actor-based concurrent object framework for Ruby☆3,870Mar 7, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A high-performance web server for Ruby, supporting HTTP/1, HTTP/2 and TLS.☆3,024Aug 11, 2026Updated last week
- Easy activity tracking for models - similar to Github's Public Activity☆2,990Jun 8, 2026Updated 2 months ago
- Thor is a toolkit for building powerful command-line interfaces.☆5,264Jul 6, 2026Updated last month
- Complete Ruby geocoding solution.☆6,446Aug 9, 2026Updated last week
- Blazing fast deployer and server automation tool☆4,355Aug 1, 2024Updated 2 years ago
- Sucker Punch is a Ruby asynchronous processing library using concurrent-ruby, heavily influenced by Sidekiq and girl_friday.☆2,631Dec 24, 2025Updated 7 months ago
- View components for Ruby and Rails.☆3,073Dec 2, 2024Updated last year