*Deprecated* A short and sweet Python web crawler using Redis as the process queue, seen set and Memcache style rate limiter for robots.txt
☆16Feb 22, 2011Updated 15 years ago
Alternatives and similar repositories for pubcrawl
Users that are interested in pubcrawl are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆14Jun 21, 2011Updated 15 years ago
- Server management tools using fabric + django cli.☆20Jul 7, 2011Updated 15 years ago
- Prospective search for python☆26Mar 7, 2026Updated 5 months ago
- Simple jQuery plugin that lets you apply responsive viewport size units (vw, vh, vmax and vmin) with browsers with incomplete CSS3 suppor…☆15Apr 12, 2016Updated 10 years ago
- ☆22Aug 24, 2017Updated 9 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Sends Resque status from Redis to Graphite.☆30Oct 28, 2023Updated 2 years ago
- Python library for Myra☆10Jan 21, 2019Updated 7 years ago
- Redis bulk-loader for Apache Pig☆40Apr 21, 2012Updated 14 years ago
- Utility functions and classes for building Artificial Intelligence systems in Python☆23Apr 14, 2017Updated 9 years ago
- Experiment files for the paper "An Analysis of Unsupervised Pre-training in Light of Recent Advances", available here: http://arxiv.org/a…☆18Feb 20, 2016Updated 10 years ago
- Slinky, a high-performance web crawler / text analytics in Python, Redis, Hadoop, R, Gephi☆40Aug 30, 2010Updated 15 years ago
- PageRank applied to the GitHub users/follows graph☆29Jan 4, 2010Updated 16 years ago
- Automated tag file generation and syntax highlighting of tags in Vim☆15Jul 3, 2015Updated 11 years ago
- ☆14Apr 6, 2014Updated 12 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A small test for recognizing persons with a word2vec model in German☆13Mar 15, 2015Updated 11 years ago
- A Storm based web crawler with Cassandra backend☆29Nov 7, 2013Updated 12 years ago
- Sample cross-platform Web Application Firewall, used as a security proxy for existing web apps☆15Oct 16, 2017Updated 8 years ago
- Chrome Extension to add sidebar of Tweets to Youtube.☆16Jul 3, 2015Updated 11 years ago
- Translate autodetect-ru and ru-en☆11Nov 9, 2020Updated 5 years ago
- Smartcrop, a multi-pass context-aware cropping tool☆11Jan 31, 2018Updated 8 years ago
- Term payloads for Elasticsearch☆11Sep 8, 2016Updated 9 years ago
- A github repo for H2O wave applications☆15Dec 21, 2020Updated 5 years ago
- ☆16Aug 17, 2011Updated 15 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- API server for TextBlob: Sentiment analysis, POS tagging, noun phrase extraction.☆24Jan 23, 2015Updated 11 years ago
- fractal video feedback demo as a PC master boot record☆18Oct 15, 2011Updated 14 years ago
- Gulp plugin to deploy tensorflow in aws lambda☆17Jul 13, 2016Updated 10 years ago
- A statsd (thanks Etsy!) client for php☆19Nov 10, 2020Updated 5 years ago
- Asynchronous framework☆18Apr 20, 2026Updated 4 months ago
- Slack Markdown Filter☆16Nov 1, 2021Updated 4 years ago
- ☆12Nov 22, 2014Updated 11 years ago
- API and Client to enable programmatic and keyboard control of a Mekamon Robot☆14May 6, 2019Updated 7 years ago
- Distributed Trie library written in Ruby.☆16Apr 28, 2012Updated 14 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Swift rewrite of audio fingerprinting using the Chromaprint C++ library.☆10Feb 6, 2017Updated 9 years ago
- Distributed twitter crawler in Python☆25Nov 4, 2022Updated 3 years ago
- MySQL export to Elasticsearch☆14Feb 6, 2017Updated 9 years ago
- They only live to get radical.☆13Nov 29, 2018Updated 7 years ago
- Disambiguation of wikipedia article name☆17Mar 15, 2017Updated 9 years ago
- Cache wrapper for lua-resty-dns☆11Apr 19, 2017Updated 9 years ago
- common crawl quick hack examples☆19Feb 11, 2015Updated 11 years ago