*Deprecated* A short and sweet Python web crawler using Redis as the process queue, seen set and Memcache style rate limiter for robots.txt
☆16Feb 22, 2011Updated 15 years ago
Alternatives and similar repositories for pubcrawl
Users that are interested in pubcrawl are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆14Jun 21, 2011Updated 15 years ago
- A real-life example of a cluster running Drupal☆16May 19, 2014Updated 12 years ago
- Server management tools using fabric + django cli.☆20Jul 7, 2011Updated 15 years ago
- Prospective search for python☆26Mar 7, 2026Updated 5 months ago
- ☆22Aug 24, 2017Updated 8 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Python library for Myra☆10Jan 21, 2019Updated 7 years ago
- Redis bulk-loader for Apache Pig☆40Apr 21, 2012Updated 14 years ago
- Slinky, a high-performance web crawler / text analytics in Python, Redis, Hadoop, R, Gephi☆40Aug 30, 2010Updated 15 years ago
- Emoji keywords to unicode mapping in easily consumable format☆11Jun 9, 2016Updated 10 years ago
- official repo now at rubygems/gemcutter!☆22Sep 4, 2010Updated 15 years ago
- ☆14Apr 6, 2014Updated 12 years ago
- a "crawler" using xargs and wget☆18Aug 26, 2010Updated 15 years ago
- A Storm based web crawler with Cassandra backend☆29Nov 7, 2013Updated 12 years ago
- Sample cross-platform Web Application Firewall, used as a security proxy for existing web apps☆15Oct 16, 2017Updated 8 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Chrome Extension to add sidebar of Tweets to Youtube.☆15Jul 3, 2015Updated 11 years ago
- Smartcrop, a multi-pass context-aware cropping tool☆11Jan 31, 2018Updated 8 years ago
- Allows you to use find_each and find_each_in_batches with custom ordering.☆16Jan 20, 2021Updated 5 years ago
- Term payloads for Elasticsearch☆11Sep 8, 2016Updated 9 years ago
- A github repo for H2O wave applications☆15Dec 21, 2020Updated 5 years ago
- API server for TextBlob: Sentiment analysis, POS tagging, noun phrase extraction.☆24Jan 23, 2015Updated 11 years ago
- A pluggable statsd backend to aggregate data and periodically forward to other statsd daemons☆20Apr 11, 2022Updated 4 years ago
- fractal video feedback demo as a PC master boot record☆18Oct 15, 2011Updated 14 years ago
- Slack Markdown Filter☆16Nov 1, 2021Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆12Nov 22, 2014Updated 11 years ago
- High performance Rust ECS library☆10Aug 15, 2020Updated 5 years ago
- Distributed Trie library written in Ruby.☆16Apr 28, 2012Updated 14 years ago
- ☆11Jun 14, 2015Updated 11 years ago
- Distributed twitter crawler in Python☆25Nov 4, 2022Updated 3 years ago
- MySQL export to Elasticsearch☆14Feb 6, 2017Updated 9 years ago
- They only live to get radical.☆13Nov 29, 2018Updated 7 years ago
- RFlow - A workflow framework for agile machine learning☆18Dec 9, 2020Updated 5 years ago
- Deprecated, use https://github.com/mozilla-services/iprepd☆15May 18, 2018Updated 8 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Multi-layer perceptron in C☆16Jan 22, 2021Updated 5 years ago
- Cache wrapper for lua-resty-dns☆11Apr 19, 2017Updated 9 years ago
- Ruby gem for interacting with the official Product Hunt API☆20Feb 7, 2017Updated 9 years ago
- common crawl quick hack examples☆19Feb 11, 2015Updated 11 years ago
- [no more maintained] A free web widget to explore graphs by a simply and intuitive way!☆17May 4, 2010Updated 16 years ago
- Extracts synonyms for various terms, exploiting the redirects between terms in Wikipedia☆12Nov 2, 2018Updated 7 years ago
- Discnt provides in memory distributed eventually consistent counters.☆10Jul 21, 2017Updated 9 years ago