Alternatives and similar repositories for python-webcrawler

Users that are interested in python-webcrawler are comparing it to the libraries listed below

• pkrumins / xgoogle
  Python library to Google services (google search, google sets, google translate, sponsored links)
  ☆217Updated 6 years ago
• andrewjw / celery-crawler
  A Django based search engine powered by CouchDB, celery and whoosh.
  ☆48Updated 10 years ago
• voliveirajr / seleniumcrawler
  An example using Selenium webdrivers for python and Scrapy framework to create a web scraper to crawl an ASP site
  ☆128Updated 6 years ago
• paulproteus / python-scraping-code-samples
  ☆231Updated 5 years ago
• realpython / stack-spider
  ☆167Updated 7 years ago
• feiskyer / scrapy-examples
  Some scrapy and web.py exmaples
  ☆79Updated 8 years ago
• mjhea0 / Scrapy-Samples
  Scrapy examples crawling Craigslist
  ☆201Updated 9 years ago
• YahooArchive / yos-social-python
  [dormant] Python SDK
  ☆62Updated 10 years ago
• geogas / scrapy-flask-imdb-python
  Python project scraping imdb and web application implemented using Flask.
  ☆54Updated 10 years ago
• suryasev / unofficial-google-trends-api
  Python-based API that uses the http site to download Google Trends data
  ☆218Updated 5 years ago
• scrapinghub / scrapylib
  Collection of Scrapy utilities (extensions, middlewares, pipelines, etc)
  ☆33Updated 7 years ago
• theanti9 / PyCrawler
  A python web crawler
  ☆213Updated 4 years ago
• rohithpr / py-web-search
  A Python module to fetch and parse results from different search engines.
  ☆79Updated 7 years ago
• scrapinghub / scmongo
  MongoDB extensions for Scrapy
  ☆44Updated 11 years ago
• jmg / crawley
  Pythonic Crawling / Scraping Framework based on Non Blocking I/O operations.
  ☆189Updated 2 years ago
• adamhadani / logtools
  Command-line utilities for working with log files - filtering, sampling, IP-based geolocation, summary statistics etc.
  ☆168Updated 4 years ago
• kumar303 / unicode-in-python
  slides for Unicode In Python, Completely Demystified (PyCon 2008)
  ☆161Updated 2 years ago
• liato / wolframalpha
  A python interface to WolframAlpha.
  ☆15Updated 15 years ago
• scrapy-plugins / scrapy-monkeylearn
  A Scrapy pipeline to categorize items using MonkeyLearn
  ☆38Updated 8 years ago
• thraxil / restclient
  official github mirror of http://code.google.com/p/microapps/wiki/Restclient
  ☆36Updated 9 years ago
• lucjon / Py-StackExchange
  A Python binding for the StackExchange API
  ☆233Updated 4 years ago
• scrapinghub / testspiders
  Useful test spiders for Scrapy
  ☆184Updated 6 years ago
• bwhite / hadoopy
  Python MapReduce library written in Cython. Visit us in #hadoopy on freenode. See the link below for documentation and tutorials.
  ☆241Updated 10 years ago
• asweigart / threadworms
  A multithreaded programming demonstration in Python & Pygame using a "Nibbles" clone.
  ☆54Updated 11 years ago
• ravikiranj / twitter-sentiment-analyzer
  Twitter Sentiment Analyzer
  ☆170Updated 7 years ago
• mitsuhiko / flask-pastebin
  Example pastebin with websockets, sqlalchemy, facebook connect and a bunch of other buzzwords
  ☆267Updated 9 years ago
• chrisspen / webarticle2text
  [DEPRECATED] A script to extract the main article text from an arbitrary webpage.
  ☆87Updated 8 years ago
• gak / pygooglechart
  pygooglechart is a complete Python wrapper for the Google Chart API.
  ☆197Updated 3 years ago
• paltman-archive / django-pdf
  Manage uploaded documents (pdfs) with backend cloud processing of the pdfs into individual pngs per page
  ☆103Updated 11 years ago
• shantnu / TwitterAnalyser
  ☆53Updated 10 years ago