*Deprecated* A short and sweet Python web crawler using Redis as the process queue, seen set and Memcache style rate limiter for robots.txt
☆16Feb 22, 2011Updated 15 years ago
Alternatives and similar repositories for pubcrawl
Users that are interested in pubcrawl are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Server management tools using fabric + django cli.☆20Jul 7, 2011Updated 15 years ago
- Match documents against large sets of saved queries in one Python process. Built for scraping and alerts.☆28Sep 6, 2026Updated 2 months ago
- Sends Resque status from Redis to Graphite.☆30Oct 28, 2023Updated 3 years ago
- ☆23Aug 24, 2017Updated 9 years ago
- A parallel Virtual Stack Machine Firmware for Arduino☆14Aug 3, 2013Updated 13 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Example of using split in a sinatra app☆12Aug 6, 2024Updated 2 years ago
- Redis bulk-loader for Apache Pig☆40Apr 21, 2012Updated 14 years ago
- A Google Chrome extension to draw and share the drawings on Slack☆11Jun 12, 2017Updated 9 years ago
- Slinky, a high-performance web crawler / text analytics in Python, Redis, Hadoop, R, Gephi☆40Aug 30, 2010Updated 16 years ago
- PageRank applied to the GitHub users/follows graph☆29Jan 4, 2010Updated 16 years ago
- Generates 301 redirects from old domains to new domains. Minimal, rack-based.☆12Jul 12, 2013Updated 13 years ago
- Heatmap provides a simple, single helper method that generates a cloud-style heatmap based on a provided histogram.☆12Mar 7, 2010Updated 16 years ago
- Sparse matrix and vector classes for Ruby☆14Oct 24, 2011Updated 15 years ago
- A relativistic solution to Einstein's equations and a ray tracer for that solution☆14May 29, 2015Updated 11 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- DEPRECATED. Use https://github.com/etsy/statsd instead of this.☆13May 17, 2012Updated 14 years ago
- Term payloads for Elasticsearch☆11Sep 8, 2016Updated 10 years ago
- A crawler and parser built in either C++ or Java☆13Jun 2, 2012Updated 14 years ago
- Ruby gem for StatsMix API☆15Aug 31, 2013Updated 13 years ago
- Smartcrop, a multi-pass context-aware cropping tool☆11Jan 31, 2018Updated 8 years ago
- Tools for working with wikidata (structured data from wikipedia)☆13Apr 26, 2016Updated 10 years ago
- A pluggable statsd backend to aggregate data and periodically forward to other statsd daemons☆20Apr 11, 2022Updated 4 years ago
- ☆12Nov 22, 2014Updated 11 years ago
- Docker/Ferry application showing how to download American Community Survey data, store the data in Cassandra, and plot using Python Bokeh☆13Apr 26, 2014Updated 12 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ☆14Apr 6, 2014Updated 12 years ago
- Allows you to use find_each and find_each_in_batches with custom ordering.☆16Jan 20, 2021Updated 5 years ago
- Semanticizest: dump parser and client☆20May 11, 2016Updated 10 years ago
- Distributed Trie library written in Ruby.☆16Apr 28, 2012Updated 14 years ago
- Asynchronous framework☆17Apr 20, 2026Updated 6 months ago
- common crawl quick hack examples☆19Feb 11, 2015Updated 11 years ago
- Swift rewrite of audio fingerprinting using the Chromaprint C++ library.☆10Feb 6, 2017Updated 9 years ago
- Makes a submission to Kaggle's wordpress competetition using LDA features☆16Jul 13, 2012Updated 14 years ago
- Autonomous Server Management with Claude Code - Let AI be your DevOps engineer☆20Aug 31, 2026Updated 2 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- text-to-speech via espeak cli program☆11Feb 19, 2013Updated 13 years ago
- Disambiguation of wikipedia article name☆17Mar 15, 2017Updated 9 years ago
- official repo now at rubygems/gemcutter!☆22Sep 4, 2010Updated 16 years ago
- A porting of mod_access_token for nginx☆11Jul 30, 2014Updated 12 years ago
- A Python wrapper for the Product Hunt Beta API☆14Sep 14, 2018Updated 8 years ago
- OpenResty ENV cache☆12Nov 16, 2017Updated 9 years ago
- BigData Workflow Engine for Hadoop, Hbase, Netezza, Pig, Hive, Redis ...☆13Dec 8, 2021Updated 4 years ago
Are these results useful?