robots.txt parser
☆40Sep 21, 2018Updated 8 years ago
Alternatives and similar repositories for robots
Users that are interested in robots are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A flexible PHP-based web crawler / spider☆12Jul 13, 2010Updated 16 years ago
- An async DNS resolver for EventMachine based on the udns C library☆37Aug 2, 2024Updated 2 years ago
- LOOKING FOR A MAINTAINER☆157Oct 21, 2019Updated 7 years ago
- Ruby fusefs for OS X☆15Dec 8, 2009Updated 16 years ago
- Simple Sinatra-based micro-blog/Twitter clone☆89Apr 1, 2009Updated 17 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Change your go versions with ease.☆16Jan 13, 2016Updated 10 years ago
- Extract Developers Notes from Source☆44Oct 12, 2022Updated 4 years ago
- Facebook clone project for the Cloning Internet Applications with Ruby book☆14Apr 16, 2010Updated 16 years ago
- A ruby gem for accessing the Yahoo Site Explorer API☆11Dec 9, 2008Updated 17 years ago
- Authentication with BasicAuth that can require different credentials for different realms.☆22Sep 15, 2010Updated 16 years ago
- Examples uses to illustrate how to write modular Rack-based web applications☆21Sep 16, 2010Updated 16 years ago
- a Rack-based resourceful web framework☆12Sep 17, 2008Updated 18 years ago
- ruby binding for parsley☆15Jan 14, 2010Updated 16 years ago
- Ruby gem for interacting with Yahoo's BOSS web service. BOSS is kind of moribund, so I'm not really maintaining this anymore.☆65Nov 13, 2011Updated 14 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Prevayler in Ruby☆15May 24, 2011Updated 15 years ago
- simple callback-based HTTP request/response parser☆203Dec 23, 2025Updated 10 months ago
- Backup your PostgreSQL database from Heroku to Amazon S3. Gem to wrap the code by Trevor Turk.☆27Apr 23, 2010Updated 16 years ago
- Augment 'require' to load non-ruby file types☆50May 30, 2014Updated 12 years ago
- JRuby-based backend for ruby-debug☆15Jul 20, 2020Updated 6 years ago
- An inline unit testing/spec framework that doesn’t force you to follow arbitrary rules☆12Feb 19, 2011Updated 15 years ago
- This repository was used in the journey I took to find the best solution for building Rails sites with full stack integration i.e. unit a…☆10Jul 26, 2011Updated 15 years ago
- ‹ᴜɴᴍᴀɪɴᴛᴀɪɴᴇᴅ› A Ruby module for accessing the ncurses library☆12Dec 25, 2015Updated 10 years ago
- How fresh is your Gemfile?☆17Jan 21, 2017Updated 9 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Repository for additional implementations☆11Feb 23, 2023Updated 3 years ago
- Ruby MIDI message objects☆21Feb 22, 2022Updated 4 years ago
- (No longer supported) Heroku buildpack for running multiple buildpacks in sequence and combining the results☆11Apr 19, 2014Updated 12 years ago
- Ruby MIDI input event listener☆25Aug 17, 2022Updated 4 years ago
- ☆24Apr 10, 2012Updated 14 years ago
- Official wrapper for Beanstalk API.☆16Nov 29, 2011Updated 14 years ago
- Pure Golang implementation of server-side ECMR exchange functionality (Tang server)☆13Mar 14, 2026Updated 7 months ago
- Aloha Drupal 7! state of the art #html5 Aloha Editor integration with RDFa support in Drupal 7☆15Apr 11, 2011Updated 15 years ago
- Ruby Library to Expand short urls☆24Feb 17, 2017Updated 9 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Ruby JSON pretty-printer☆32Nov 18, 2009Updated 16 years ago
- convert chinese to pinyin☆11Feb 8, 2012Updated 14 years ago
- An awesome language detector☆72Mar 3, 2012Updated 14 years ago
- Elixir crawler with an awesome name☆12Sep 7, 2015Updated 11 years ago
- ☆11Oct 1, 2026Updated last month
- Like Heroku's gem manifests, but for your own computer☆11May 20, 2009Updated 17 years ago
- ActiveRecord/ActiveModel's like interface for Lucene☆21Jun 14, 2010Updated 16 years ago