A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
☆834Jan 12, 2026Updated 2 months ago
Alternatives and similar repositories for spidr
Users that are interested in spidr are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Lightweight Ruby web crawler/scraper with an elegant DSL which extracts structured data from pages.☆1,355Mar 10, 2026Updated 2 weeks ago
- Anemone web-spider framework☆1,607Mar 20, 2020Updated 6 years ago
- Mechanize is a ruby library that makes automated web interaction easy.☆4,440Feb 20, 2026Updated last month
- Fast high-level web crawling Ruby framework☆682Jul 3, 2024Updated last year
- Write web scrapers in Ruby using a clean, AI-assisted DSL. Kimurai uses AI to figure out where the data lives, then caches the selectors …☆1,096Jan 27, 2026Updated 2 months ago
- Wordpress hosting with auto-scaling on Cloudways • AdFully Managed hosting built for WordPress-powered businesses that need reliable, auto-scalable hosting. Cloudways SafeUpdates now available.
- Ruby on SQLite☆271Jan 25, 2026Updated 2 months ago
- Ruby: parallel processing made simple and fast☆4,234Dec 3, 2025Updated 3 months ago
- Headless Chrome Ruby API☆1,989Updated this week
- 🍯 Unobtrusive and flexible spam protection for Rails apps☆1,240Jan 30, 2025Updated last year
- Ruby gem for web scraping purposes. It scrapes a given URL, and returns you its title, meta description, meta keywords, links, images...☆1,046Jan 29, 2026Updated last month
- HTTP (The Gem! a.k.a. http.rb) - a fast Ruby HTTP client with a chainable API, streaming support, and timeouts☆3,128Mar 20, 2026Updated last week
- A high-performance web server for Ruby, supporting HTTP/1, HTTP/2 and TLS.☆2,964Mar 19, 2026Updated last week
- Streaming downloads using Net::HTTP, http.rb or HTTPX☆1,059Mar 18, 2026Updated last week
- Web crawler with very flexible crawling options. Can either use standalone or can be used with resque to perform clustered crawls.☆224Dec 1, 2022Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click and start building anything your business needs.
- Versatile PDF creation and manipulation for Ruby☆1,359Mar 12, 2026Updated 2 weeks ago
- File Attachment toolkit for Ruby applications☆3,273Jan 2, 2026Updated 2 months ago
- Simple, powerful, first-party analytics for Rails☆4,433Updated this week
- Curated List: Practical Natural Language Processing done in Ruby☆1,074Jun 27, 2023Updated 2 years ago
- a minimal, fast, safe sql executor☆399Sep 17, 2024Updated last year
- Spreadsheet Architect is a library that allows you to create XLSX, ODS, or CSV spreadsheets super easily from ActiveRecord relations, pla…☆1,350Dec 27, 2025Updated 2 months ago
- Shale is a Ruby object mapper and serializer for JSON, YAML, TOML, CSV and XML. It allows you to parse JSON, YAML, TOML, CSV and XML data…☆671Jul 22, 2025Updated 8 months ago
- Generate a static site from any rack middleware.☆70Sep 3, 2024Updated last year
- Data processing & ETL framework for Ruby☆1,774Jan 10, 2026Updated 2 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- A micro library providing Ruby objects with Publish-Subscribe capabilities☆3,323Aug 15, 2024Updated last year
- Boot large Ruby/Rails apps faster☆2,721Feb 12, 2026Updated last month
- The simplest way to group temporal data☆3,881Dec 26, 2025Updated 3 months ago
- Routing Tree Web Toolkit☆2,212Mar 14, 2026Updated last week
- Versioned database views for Rails☆3,616Nov 14, 2025Updated 4 months ago
- An awesome asynchronous event-driven reactor for Ruby.☆2,431Mar 17, 2026Updated last week
- Modern concurrency tools including agents, futures, promises, thread pools, supervisors, and more. Inspired by Erlang, Clojure, Scala, Go…☆5,811Jan 11, 2026Updated 2 months ago
- Freeze all core ruby classes☆293Mar 15, 2026Updated last week
- Sequel: The Database Toolkit for Ruby☆5,083Updated this week
- DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Beautiful and interactive visualizations for your ruby web pages powered by ApexCharts.JS.☆487Oct 6, 2025Updated 5 months ago
- iodine - HTTP / WebSockets Server for Ruby with Pub/Sub support☆962Mar 2, 2026Updated 3 weeks ago
- Median and percentile for Active Record, Mongoid, arrays, and hashes☆476Dec 27, 2025Updated 3 months ago
- A high performance implementation of the Ruby programming language, built on GraalVM.☆3,184Mar 20, 2026Updated last week
- Rack middleware for blocking & throttling☆5,730Mar 20, 2026Updated last week
- A framework for building reusable, testable & encapsulated view components in Ruby on Rails.☆3,543Updated this week
- Multithreaded, Postgres-based, Active Job backend for Ruby on Rails.☆2,945Mar 20, 2026Updated last week