*Deprecated* A short and sweet Python web crawler using Redis as the process queue, seen set and Memcache style rate limiter for robots.txt
☆16Feb 22, 2011Updated 15 years ago
Alternatives and similar repositories for pubcrawl
Users that are interested in pubcrawl are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆22Aug 24, 2017Updated 9 years ago
- Sends Resque status from Redis to Graphite.☆30Oct 28, 2023Updated 2 years ago
- Redis bulk-loader for Apache Pig☆40Apr 21, 2012Updated 14 years ago
- Slinky, a high-performance web crawler / text analytics in Python, Redis, Hadoop, R, Gephi☆40Aug 30, 2010Updated 16 years ago
- PageRank applied to the GitHub users/follows graph☆29Jan 4, 2010Updated 16 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Automated tag file generation and syntax highlighting of tags in Vim☆15Jul 3, 2015Updated 11 years ago
- ☆14Apr 6, 2014Updated 12 years ago
- A small test for recognizing persons with a word2vec model in German☆13Mar 15, 2015Updated 11 years ago
- a "crawler" using xargs and wget☆18Aug 26, 2010Updated 16 years ago
- A Storm based web crawler with Cassandra backend☆29Nov 7, 2013Updated 12 years ago
- StatsD Backend for Instrumental Application Monitoring☆18Apr 14, 2020Updated 6 years ago
- Ruby gem for StatsMix API☆15Aug 31, 2013Updated 13 years ago
- Allows you to use find_each and find_each_in_batches with custom ordering.☆16Jan 20, 2021Updated 5 years ago
- ☆16Aug 17, 2011Updated 15 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Gulp plugin to deploy tensorflow in aws lambda☆17Jul 13, 2016Updated 10 years ago
- Slack Markdown Filter☆16Nov 1, 2021Updated 4 years ago
- API and Client to enable programmatic and keyboard control of a Mekamon Robot☆14May 6, 2019Updated 7 years ago
- Distributed Trie library written in Ruby.☆16Apr 28, 2012Updated 14 years ago
- Swift rewrite of audio fingerprinting using the Chromaprint C++ library.☆10Feb 6, 2017Updated 9 years ago
- ☆11Jun 14, 2015Updated 11 years ago
- Index music album from the MusicBrainz open music encyclopedia into Elasticsearch☆18Dec 8, 2023Updated 2 years ago
- MySQL export to Elasticsearch☆14Feb 6, 2017Updated 9 years ago
- They only live to get radical.☆13Nov 29, 2018Updated 7 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Disambiguation of wikipedia article name☆17Mar 15, 2017Updated 9 years ago
- A set of examples around pytorch in Vision, Text, Reinforcement Learning, etc.☆10Mar 3, 2020Updated 6 years ago
- common crawl quick hack examples☆19Feb 11, 2015Updated 11 years ago
- [no more maintained] A free web widget to explore graphs by a simply and intuitive way!☆17May 4, 2010Updated 16 years ago
- Extracts synonyms for various terms, exploiting the redirects between terms in Wikipedia☆12Nov 2, 2018Updated 7 years ago
- Discnt provides in memory distributed eventually consistent counters.☆10Jul 21, 2017Updated 9 years ago
- fast haml for python☆18Nov 6, 2013Updated 12 years ago
- OpenResty ENV cache☆12Nov 16, 2017Updated 8 years ago
- simple pure-python tool to parse mmdb files and convert them to the old format Tor uses☆10Nov 25, 2017Updated 8 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- DoSeR with entity disambiguation components only☆16Jan 29, 2019Updated 7 years ago
- Customizable rate limiting and throttling for multi-process ruby applications based on Redis.☆16Mar 29, 2018Updated 8 years ago
- Makes a submission to Kaggle's wordpress competetition using LDA features☆16Jul 13, 2012Updated 14 years ago
- Google Universial Analytics Measurement Protocol Implementation for Java☆11May 29, 2013Updated 13 years ago
- A Python wrapper for the Product Hunt Beta API☆14Sep 14, 2018Updated 8 years ago
- Building blocks for Information Retrieval & Machine Learning☆16Oct 12, 2010Updated 15 years ago
- Sendwithus Ruby Client☆18Jun 5, 2025Updated last year