Web crawler with very flexible crawling options. Can either use standalone or can be used with resque to perform clustered crawls.
☆224Dec 1, 2022Updated 3 years ago
Alternatives and similar repositories for cobweb
Users that are interested in cobweb are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Lightweight Ruby web crawler/scraper with an elegant DSL which extracts structured data from pages.☆1,361Apr 7, 2026Updated 3 weeks ago
- A mean little DSL'd poltergeist (capybara) based web crawler that stuffs data into your Rails app.☆21Jul 18, 2013Updated 12 years ago
- Slim for Volt framework☆13Jan 5, 2016Updated 10 years ago
- A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fas…☆835Jan 12, 2026Updated 3 months ago
- a simple, fast web-crawler written in Ruby using Watir or Typhoeus☆16Jan 26, 2024Updated 2 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- an re-implementation of rmmseg (Chinese word segmentation library for Ruby) in C++ in new rake-compiler☆16Apr 18, 2016Updated 10 years ago
- Ruby gem for web scraping purposes. It scrapes a given URL, and returns you its title, meta description, meta keywords, links, images...☆1,047Apr 9, 2026Updated 3 weeks ago
- Anemone web-spider framework☆1,605Mar 20, 2020Updated 6 years ago
- A Material Design theme for Administrate based on Materialize framework☆15Apr 29, 2022Updated 4 years ago
- Asynchronous Web Crawler & Scraper☆143Mar 23, 2023Updated 3 years ago
- Ocarina - Optical Character Recognition (OCR) for Ruby☆24Dec 2, 2012Updated 13 years ago
- Ruby library - Fill out PDF form with FDF/XFDF via pdftk☆16Sep 28, 2021Updated 4 years ago
- Machine Learning & Data Mining with JRuby☆65Dec 23, 2025Updated 4 months ago
- An add-on gem for spelling suggestions in Thinking Sphinx☆58Mar 3, 2020Updated 6 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Extracts machine-readable metadata and content from Web pages☆745Apr 10, 2019Updated 7 years ago
- Extract useful data from HTML and XML with ease!☆57Jan 3, 2018Updated 8 years ago
- An Evented Beanstalk Client☆64Jul 27, 2012Updated 13 years ago
- Collection of text algorithms. gem install text☆585Apr 13, 2015Updated 11 years ago
- A ruby gem that can convert HTML to formatted plain text.☆42Feb 14, 2019Updated 7 years ago
- Ruby Microdata parser for RDF.rb☆33Jan 8, 2024Updated 2 years ago
- Struct with keyword arguments support☆18Jan 8, 2023Updated 3 years ago
- A Ruby DSL for structured web crawling, with a robust caching system.☆256Mar 19, 2024Updated 2 years ago
- Partisan is a Ruby library that allows ActiveRecord records to be followers and followables.☆32Dec 21, 2017Updated 8 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Mechanize is a ruby library that makes automated web interaction easy.☆4,443Feb 20, 2026Updated 2 months ago
- Demo app showing how you can filter a table in a Ruby on Rails app with StimulusReflex☆17Jan 19, 2023Updated 3 years ago
- jQuery Templates for the Rails asset pipeline.☆46Jan 20, 2016Updated 10 years ago
- Rails gem for managing web site agreements (terms, privacy policy, etc).☆40Jan 7, 2025Updated last year
- A simple Ruby example of how to process Common Crawl files using Elastic MapReduce☆29Mar 25, 2012Updated 14 years ago
- postgresql fuzzywuzzy extension☆12Feb 27, 2019Updated 7 years ago
- Micro web app for Text-To-Speech conversion via HTTP powered by Ruby, Roda, lame, espeak and espeak-ruby.☆27Nov 28, 2021Updated 4 years ago
- Web crawler with a Ruby API☆44Feb 17, 2021Updated 5 years ago
- A gem to record data about Ruby code execution in Neo4j for analysis☆18Jan 12, 2016Updated 10 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Rails engine to manage and supervise your batch jobs. Based on sidekiq.☆34May 23, 2024Updated last year
- DEPRECATED - Ruby library for generating text with declarative recursive grammars, a fork of maetl/Calyx☆28Jul 30, 2016Updated 9 years ago
- Ruby wrapper for phantomjs☆53Feb 29, 2020Updated 6 years ago
- Ruby on Rails course☆15Nov 23, 2015Updated 10 years ago
- Wgit enables you to crawl and extract the data you want from the web☆16Updated this week
- executable rubygem for easily downloading youtube videos using curl☆23Sep 3, 2010Updated 15 years ago
- Ruby on Rails CMS for Rails 6+. Integral aims to lower the barrier of entry to creating great websites.☆24Jan 21, 2023Updated 3 years ago