Easy to use extension of Net::HTTP to let you obey robots.txt while crawling/scrapping/mining
☆11Aug 30, 2009Updated 17 years ago
Alternatives and similar repositories for obey_robots_dot_txt
Users that are interested in obey_robots_dot_txt are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- fork of ruby 1.8.7p72 with branches for various gc and thread related patches☆16Mar 27, 2009Updated 17 years ago
- Simple URL shortener☆12Jun 30, 2010Updated 16 years ago
- Fixes the Rails CookieStore lazy loading so that empty sessions don't get sent to the client☆13Apr 29, 2010Updated 16 years ago
- Native MRI callback☆19Oct 7, 2009Updated 17 years ago
- Simplify and organize stylesheet development on your Rails project☆16Oct 16, 2009Updated 17 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Rails Bootstrapping Site☆43Aug 25, 2010Updated 16 years ago
- Simple OO Class factory☆14Jun 3, 2011Updated 15 years ago
- Use jqTree with the Rails 3 asset pipeline☆22Oct 4, 2020Updated 6 years ago
- A fast network I/O and event-management framework for Ruby, Java, and C++ programmers.☆13Sep 7, 2008Updated 18 years ago
- Create independent sets of validations with the full power of ActiveRecord's validation macros☆66Jan 12, 2024Updated 2 years ago
- Machine-readable variants of NGINX directive documentation for use in other tools.☆13Oct 23, 2026Updated 3 weeks ago
- AMQP client implementation in Ruby/EventMachine☆12Dec 17, 2010Updated 15 years ago
- A partially completed, bug ridden CSS parser written in treetop (please fork me)☆18Jul 16, 2008Updated 18 years ago
- Simple & Helpful Field Helpers for Rails e.g. check_box_with_label or prefilled fields from params☆18Nov 10, 2011Updated 15 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- extend actionmailer to allow one smtp account per mailer class.☆23Jul 7, 2013Updated 13 years ago
- Add terminal color support to command line node.js☆13Feb 19, 2010Updated 16 years ago
- Unicorn web server configurations optimized for running on Heroku☆14Mar 1, 2013Updated 13 years ago
- Paperclip File Management Plugin including patches while trying to maintain sync with Master☆15Jan 17, 2010Updated 16 years ago
- Fantastic forum software for Rails 3☆21Oct 3, 2010Updated 16 years ago
- A Rack middleware to redirect (*cough* kick) IE6 users out of your website☆25Oct 6, 2013Updated 13 years ago
- Zero-effort creation of Location-aware Rails application based on W3C Geolocaton API.☆115Jul 21, 2015Updated 11 years ago
- Add comment support to Rails apps with this plugin☆23Aug 1, 2011Updated 15 years ago
- A standalone pub/sub messaging server which supports TCP, UDP and latest WebSocket protocol☆19Sep 12, 2012Updated 14 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Adds a :expires_in option to Rails filestore caching, in line with memcached store. Providing a very easy way to add high capacity cachin…☆48Oct 19, 2009Updated 17 years ago
- A handy tool helping transfer your local Rails project to an i18n one by extracting text from HTML and helper methods.☆55Jan 14, 2010Updated 16 years ago
- Import your Hipchat favorite emojis to Slack☆11Feb 7, 2023Updated 3 years ago
- A pretty dsl on top of nodeunit.☆19Sep 27, 2011Updated 15 years ago
- Custom Resource Name Plugin adds in your Ruby on Rails project the feature to create aliases for your named routes. This is extremely imp…☆24Aug 5, 2008Updated 18 years ago
- A basic skeleton for ActiveRecord-backed Ruby apps☆26Dec 17, 2013Updated 12 years ago
- Allows the use of most functionality from ActiveRecord without a database☆29Sep 2, 2009Updated 17 years ago
- Annotation to easily define ad-hoc / one-shot extension traits☆16Aug 20, 2026Updated 2 months ago
- Entasis provides a few neat methods for building a basic class. Handy for models without a database.☆18Oct 9, 2023Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Blank is GiraffeSoft’s blank rails starter app.☆61Aug 22, 2009Updated 17 years ago
- Regular Expression Construction☆182Sep 3, 2012Updated 14 years ago
- Rails plugin for using the less css framework (http://www.lesscss.org)☆24Mar 2, 2010Updated 16 years ago
- AWS signature V4 library for OpenResty + Lua☆11Sep 25, 2018Updated 8 years ago
- Simple rails process monitoring for passenger 3☆26Oct 1, 2012Updated 14 years ago
- Example SPARQL queries, mostly for working with ZBW data sets☆16Oct 8, 2025Updated last year
- Test Kitchen for LX Zones☆12May 8, 2018Updated 8 years ago
Are these results useful?