A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use.
☆835Jan 12, 2026Updated 4 months ago
Alternatives and similar repositories for spidr
Users that are interested in spidr are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Lightweight Ruby web crawler/scraper with an elegant DSL which extracts structured data from pages.☆1,362Apr 7, 2026Updated last month
- Anemone web-spider framework☆1,604Mar 20, 2020Updated 6 years ago
- Mechanize is a ruby library that makes automated web interaction easy.☆4,444May 10, 2026Updated 2 weeks ago
- Fast high-level web crawling Ruby framework☆683Jul 3, 2024Updated last year
- Write web scrapers in Ruby using a clean, AI-assisted DSL. Kimurai uses AI to figure out where the data lives, then caches the selectors …☆1,100Jan 27, 2026Updated 4 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Ruby on SQLite☆274Jan 25, 2026Updated 4 months ago
- Ruby: parallel processing made simple and fast☆4,259May 15, 2026Updated 2 weeks ago
- Headless Chrome Ruby API☆2,020Updated this week
- 🍯 Unobtrusive and flexible spam protection for Rails apps☆1,245Jan 30, 2025Updated last year
- Ruby gem for web scraping purposes. It scrapes a given URL, and returns you its title, meta description, meta keywords, links, images...☆1,048May 14, 2026Updated 2 weeks ago
- HTTP (The Gem! a.k.a. http.rb) - a fast Ruby HTTP client with a chainable API, streaming support, and timeouts☆3,074Apr 20, 2026Updated last month
- A high-performance web server for Ruby, supporting HTTP/1, HTTP/2 and TLS.☆2,997Apr 9, 2026Updated last month
- Streaming downloads using Net::HTTP, http.rb or HTTPX☆1,062May 6, 2026Updated 3 weeks ago
- Web crawler with very flexible crawling options. Can either use standalone or can be used with resque to perform clustered crawls.☆224Dec 1, 2022Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Versatile PDF creation and manipulation for Ruby☆1,373May 14, 2026Updated 2 weeks ago
- File Attachment toolkit for Ruby applications☆3,275May 16, 2026Updated last week
- Simple, powerful, first-party analytics for Rails☆4,454Apr 8, 2026Updated last month
- a minimal, fast, safe sql executor☆399Sep 17, 2024Updated last year
- Curated List: Practical Natural Language Processing done in Ruby☆1,073Jun 27, 2023Updated 2 years ago
- Spreadsheet Architect is a library that allows you to create XLSX, ODS, or CSV spreadsheets super easily from ActiveRecord relations, pla…☆1,349Apr 27, 2026Updated last month
- Shale is a Ruby object mapper and serializer for JSON, YAML, TOML, CSV and XML. It allows you to parse JSON, YAML, TOML, CSV and XML data…☆671Jul 22, 2025Updated 10 months ago
- Generate a static site from any rack middleware.☆73Sep 3, 2024Updated last year
- Data processing & ETL framework for Ruby☆1,773Jan 10, 2026Updated 4 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A micro library providing Ruby objects with Publish-Subscribe capabilities☆3,329Aug 15, 2024Updated last year
- Boot large Ruby/Rails apps faster☆2,725May 13, 2026Updated 2 weeks ago
- The simplest way to group temporal data☆3,885Apr 4, 2026Updated last month
- Versioned database views for Rails☆3,621Nov 14, 2025Updated 6 months ago
- Routing Tree Web Toolkit☆2,218May 19, 2026Updated last week
- Modern concurrency tools including agents, futures, promises, thread pools, supervisors, and more. Inspired by Erlang, Clojure, Scala, Go…☆5,818May 6, 2026Updated 3 weeks ago
- Freeze all core ruby classes☆293Updated this week
- An awesome asynchronous event-driven reactor for Ruby.☆2,443Apr 5, 2026Updated last month
- Sequel: The Database Toolkit for Ruby☆5,085May 9, 2026Updated 2 weeks ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Beautiful and interactive visualizations for your ruby web pages powered by ApexCharts.JS.☆486Oct 6, 2025Updated 7 months ago
- Rescue and report exceptions in non-critical code☆566Apr 2, 2026Updated last month
- iodine - HTTP / WebSockets Server for Ruby with Pub/Sub support☆968Updated this week
- Median and percentile for Active Record, Mongoid, arrays, and hashes☆475Apr 4, 2026Updated last month
- A high performance implementation of the Ruby programming language, built on GraalVM.☆3,208May 21, 2026Updated last week
- A framework for building reusable, testable & encapsulated view components in Ruby on Rails.☆3,560Updated this week
- Rack middleware for blocking & throttling☆5,735Apr 5, 2026Updated last month