*Deprecated* A short and sweet Python web crawler using Redis as the process queue, seen set and Memcache style rate limiter for robots.txt
☆16Feb 22, 2011Updated 15 years ago
Alternatives and similar repositories for pubcrawl
Users that are interested in pubcrawl are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A real-life example of a cluster running Drupal☆16May 19, 2014Updated 12 years ago
- ☆22Aug 24, 2017Updated 9 years ago
- Python library for Myra☆10Jan 21, 2019Updated 7 years ago
- Redis bulk-loader for Apache Pig☆40Apr 21, 2012Updated 14 years ago
- Emoji keywords to unicode mapping in easily consumable format☆11Jun 9, 2016Updated 10 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- PageRank applied to the GitHub users/follows graph☆29Jan 4, 2010Updated 16 years ago
- ARCHIVED--Docker app to crawl URLs and generate WARCs☆10Apr 11, 2017Updated 9 years ago
- official repo now at rubygems/gemcutter!☆22Sep 4, 2010Updated 16 years ago
- A very simple "markdown" to "vimdoc" converter.☆17Apr 19, 2025Updated last year
- A small test for recognizing persons with a word2vec model in German☆13Mar 15, 2015Updated 11 years ago
- A neovim colorscheme inspired by alto's odyssey.☆11Apr 9, 2025Updated last year
- A Storm based web crawler with Cassandra backend☆29Nov 7, 2013Updated 12 years ago
- StatsD Backend for Instrumental Application Monitoring☆18Apr 14, 2020Updated 6 years ago
- Sample cross-platform Web Application Firewall, used as a security proxy for existing web apps☆15Oct 16, 2017Updated 8 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Chrome Extension to add sidebar of Tweets to Youtube.☆16Jul 3, 2015Updated 11 years ago
- Translate autodetect-ru and ru-en☆11Nov 9, 2020Updated 5 years ago
- Smartcrop, a multi-pass context-aware cropping tool☆11Jan 31, 2018Updated 8 years ago
- Allows you to use find_each and find_each_in_batches with custom ordering.☆16Jan 20, 2021Updated 5 years ago
- ☆16Aug 17, 2011Updated 15 years ago
- Example repo for uploading files to S3 with the AWS SDK and Rails 4.2☆13Feb 10, 2015Updated 11 years ago
- Asynchronous framework☆17Apr 20, 2026Updated 4 months ago
- ☆12Nov 22, 2014Updated 11 years ago
- Distributed Trie library written in Ruby.☆16Apr 28, 2012Updated 14 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Swift rewrite of audio fingerprinting using the Chromaprint C++ library.☆10Feb 6, 2017Updated 9 years ago
- ☆11Jun 14, 2015Updated 11 years ago
- MySQL export to Elasticsearch☆14Feb 6, 2017Updated 9 years ago
- They only live to get radical.☆13Nov 29, 2018Updated 7 years ago
- RFlow - A workflow framework for agile machine learning☆18Dec 9, 2020Updated 5 years ago
- Disambiguation of wikipedia article name☆17Mar 15, 2017Updated 9 years ago
- Deprecated, use https://github.com/mozilla-services/iprepd☆15May 18, 2018Updated 8 years ago
- Cache wrapper for lua-resty-dns☆11Apr 19, 2017Updated 9 years ago
- [no more maintained] A free web widget to explore graphs by a simply and intuitive way!☆17May 4, 2010Updated 16 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Extracts synonyms for various terms, exploiting the redirects between terms in Wikipedia☆12Nov 2, 2018Updated 7 years ago
- Discnt provides in memory distributed eventually consistent counters.☆10Jul 21, 2017Updated 9 years ago
- fast haml for python☆18Nov 6, 2013Updated 12 years ago
- OpenResty ENV cache☆12Nov 16, 2017Updated 8 years ago
- simple pure-python tool to parse mmdb files and convert them to the old format Tor uses☆10Nov 25, 2017Updated 8 years ago
- DoSeR with entity disambiguation components only☆16Jan 29, 2019Updated 7 years ago
- Auto-scale Rackspace Cloud servers with Fabric and Celery☆23Sep 15, 2013Updated 13 years ago