fizx / robots
robots.txt parser
☆40Updated 6 years ago
Alternatives and similar repositories for robots:
Users that are interested in robots are comparing it to the libraries listed below
- A Ruby library for finding files in a set of paths☆140Updated 9 years ago
- Fork of Paul's code base to add Ruby 1.9 compatibility (and more). [NOTE: This fork has been abandoned; for more and improved functionali…☆112Updated 13 years ago
- a big hairy fuzzy spider that crawls your site, wreaking havoc☆444Updated 11 years ago
- A Sinatra Extension that makes Page and Fragment Caching easy☆161Updated 12 years ago
- Official! Ruby library for the Gearman distributed job system☆97Updated 5 years ago
- Ruby Client API for Sphinx☆136Updated 2 years ago
- Extensible Ruby wrapper for Atom and RSS parsers☆134Updated 10 years ago
- [Dead] Paypal NVP API Class☆38Updated 8 years ago
- An HTTP/1.1 pipelining implementation atop Net::HTTP☆42Updated 7 years ago
- If you're using Sinatra, you should use sinatra-flash instead.☆186Updated 11 years ago
- libsnappy binding for Ruby☆180Updated last year
- Find out which gems in your bundle are outdated.☆46Updated 10 years ago
- Rack Middleware for parsing post body data for JSON, XML and various content types