Spider is a Web spidering library for Ruby. It handles the robots.txt, scraping, collecting, and looping so that you can just handle the data.
☆27Sep 13, 2008Updated 17 years ago
Alternatives and similar repositories for spider
Users that are interested in spider are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- An ActiveRecord database adapter that allows you to setup a "master/slave" environment☆100Nov 9, 2009Updated 16 years ago
- A really simple event/hook/callback implementation that extends the Object class by default, or can be used to extend modules and classes…☆22Mar 14, 2013Updated 13 years ago
- Obey robots.txt on top of em-http-request (Asynchronous HTTP Client)☆22Sep 13, 2010Updated 15 years ago
- Demonstrates the use of the compass-jquery-plugin.☆15Dec 22, 2011Updated 14 years ago
- Command-line tool for interacting with Pancake.☆14Mar 9, 2014Updated 12 years ago
- DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Modular Scale tool for iota CSS☆10May 17, 2017Updated 8 years ago
- code for the ml class☆29Jul 31, 2011Updated 14 years ago
- A Compass plugin that contains a library of CSS font-stacks.☆38Sep 6, 2011Updated 14 years ago
- ☆21Feb 14, 2022Updated 4 years ago
- A Vue.js project starter template w/ Tachyons, Webpack, and ESLint☆12May 9, 2017Updated 8 years ago
- make an ai chatbot out of any youtube video :)☆23Feb 11, 2023Updated 3 years ago
- degrade stackedit as a local markdown editor☆22Oct 12, 2014Updated 11 years ago
- Extremely fast and efficient Ruby domain spider☆36Jan 17, 2014Updated 12 years ago
- Really basic (at this stage) messages plugin for Refinery CMS to give users the ability to publish audio or video files on their website☆16Feb 16, 2011Updated 15 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Code to accompany my Zippy Android talk at Google I/O 2010☆27May 20, 2010Updated 15 years ago
- Sass color scheme generator☆48Nov 17, 2009Updated 16 years ago
- Simurai’s site as a Harp boilerplate.☆21Dec 11, 2015Updated 10 years ago
- Eagle and CAD files for the ISS Notify Lamp☆17Nov 8, 2014Updated 11 years ago
- ☆15Sep 13, 2010Updated 15 years ago
- Jumo.com App☆55Mar 29, 2022Updated 3 years ago
- Fast yaml serialization in pure Ruby☆54Sep 6, 2012Updated 13 years ago
- Simple HTML/XML/BBCode DOM component for PHP.☆24Nov 1, 2011Updated 14 years ago
- Examples for crystal-redis☆10Sep 23, 2017Updated 8 years ago
- DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Tool to define ranges of hours (i.e. to set opening hours)☆18Jan 20, 2014Updated 12 years ago
- A small plugin for gedit to autosave when the window goes out of focus.☆23Jan 4, 2026Updated 2 months ago
- `which` for open files☆15Jan 23, 2013Updated 13 years ago
- Brunch with Hipsters is a rad Brunch app skeleton that comes with unicorns out of the box.☆112Oct 4, 2018Updated 7 years ago
- Preload and fork ruby interpreter for fast script startup☆68Dec 19, 2010Updated 15 years ago
- Thread-ed Background Workers on top of JRuby::Rack☆54May 7, 2018Updated 7 years ago
- A stunning android pull refresh and load more listView by SwipeRefreshLayout and LoadMoreListView.☆23Aug 5, 2014Updated 11 years ago
- Implementation of Facebook's high-performance pipelining technique „BigPipe“, written in PHP & JS.☆11Oct 24, 2021Updated 4 years ago
- A GridView which has a sticky header and can expand with animation☆11Dec 4, 2015Updated 10 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- LightAdmin and JHipster integration example☆18Dec 17, 2023Updated 2 years ago
- NHentaiAPI☆12Apr 12, 2017Updated 8 years ago
- ☆15Feb 17, 2017Updated 9 years ago
- ☆28Jul 22, 2014Updated 11 years ago
- Sync elinks with Firefox☆11Oct 23, 2012Updated 13 years ago
- The blazing fast CodeBurner Routing system.☆10Aug 15, 2016Updated 9 years ago
- A Harp boilerplate.☆25Apr 18, 2015Updated 10 years ago