Easy to use extension of Net::HTTP to let you obey robots.txt while crawling/scrapping/mining
☆11Aug 30, 2009Updated 17 years ago
Alternatives and similar repositories for obey_robots_dot_txt
Users that are interested in obey_robots_dot_txt are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Simplify and organize stylesheet development on your Rails project☆16Oct 16, 2009Updated 17 years ago
- Native MRI callback☆19Oct 7, 2009Updated 17 years ago
- Rails Bootstrapping Site☆44Aug 25, 2010Updated 16 years ago
- Allows the use of most functionality from ActiveRecord without a database☆29Sep 2, 2009Updated 17 years ago
- Use jqTree with the Rails 3 asset pipeline☆22Oct 4, 2020Updated 6 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Create independent sets of validations with the full power of ActiveRecord's validation macros☆66Jan 12, 2024Updated 2 years ago
- A partially completed, bug ridden CSS parser written in treetop (please fork me)☆18Jul 16, 2008Updated 18 years ago
- Simple & Helpful Field Helpers for Rails e.g. check_box_with_label or prefilled fields from params☆18Nov 10, 2011Updated 14 years ago
- extend actionmailer to allow one smtp account per mailer class.☆23Jul 7, 2013Updated 13 years ago
- Import your Hipchat favorite emojis to Slack☆11Feb 7, 2023Updated 3 years ago
- Fantastic forum software for Rails 3☆21Oct 3, 2010Updated 16 years ago
- A Rack middleware to redirect (*cough* kick) IE6 users out of your website☆25Oct 6, 2013Updated 13 years ago
- Add comment support to Rails apps with this plugin☆23Aug 1, 2011Updated 15 years ago
- Adds a :expires_in option to Rails filestore caching, in line with memcached store. Providing a very easy way to add high capacity cachin…☆48Oct 19, 2009Updated 17 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- A handy tool helping transfer your local Rails project to an i18n one by extracting text from HTML and helper methods.☆55Jan 14, 2010Updated 16 years ago
- A simple GTK app for http testing☆16Feb 7, 2021Updated 5 years ago
- Custom Resource Name Plugin adds in your Ruby on Rails project the feature to create aliases for your named routes. This is extremely imp…☆24Aug 5, 2008Updated 18 years ago
- A basic skeleton for ActiveRecord-backed Ruby apps☆26Dec 17, 2013Updated 12 years ago
- Simple rails process monitoring for passenger 3☆26Oct 1, 2012Updated 14 years ago
- Annotation to easily define ad-hoc / one-shot extension traits☆16Aug 20, 2026Updated 2 months ago
- Select availability messages for products in a Spree Commerce store☆12Oct 31, 2011Updated 14 years ago
- Entasis provides a few neat methods for building a basic class. Handy for models without a database.☆18Oct 9, 2023Updated 3 years ago
- Blank is GiraffeSoft’s blank rails starter app.☆61Aug 22, 2009Updated 17 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Regular Expression Construction☆182Sep 3, 2012Updated 14 years ago
- Rails plugin for using the less css framework (http://www.lesscss.org)☆24Mar 2, 2010Updated 16 years ago
- AWS signature V4 library for OpenResty + Lua☆11Sep 25, 2018Updated 8 years ago
- Test Kitchen for LX Zones☆12May 8, 2018Updated 8 years ago
- ☆11Apr 20, 2016Updated 10 years ago
- A little gem that helps you cleanup old, unneeded data from a Spree database.☆11Jun 11, 2014Updated 12 years ago
- Renders different templates depending on browser user_agent.☆13Aug 16, 2010Updated 16 years ago
- Vim plugin that searches http://apidock.com Ruby, Rails, and RSpec docs from within Vim.☆30Mar 24, 2009Updated 17 years ago
- Rails: A Rails scaffold generator that generates DRYer, cleaner, and more useful code. IMPORTANT: Not maintained anymore.☆124Mar 21, 2010Updated 16 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Manta WebAPI☆15Sep 3, 2026Updated last month
- Continuous Integration. In a Box!☆34Sep 17, 2009Updated 17 years ago
- CLI for templating based on JSON, YAML or HCL configuration☆13Jan 1, 2026Updated 9 months ago
- a rails plugin that gives adds a facebook like translation system to your rails app☆16Oct 7, 2009Updated 17 years ago
- ☆11Oct 2, 2025Updated last year
- ☆14Mar 15, 2013Updated 13 years ago
- or: How I Learned to Stop Worrying About SPAM☆42May 4, 2012Updated 14 years ago