Alternatives and similar repositories for python-webcrawler:

Users that are interested in python-webcrawler are comparing it to the libraries listed below

• andrewjw / celery-crawler
  A Django based search engine powered by CouchDB, celery and whoosh.
  ☆49Updated 9 years ago
• theanti9 / PyCrawler
  A python web crawler
  ☆212Updated 3 years ago
• voliveirajr / seleniumcrawler
  An example using Selenium webdrivers for python and Scrapy framework to create a web scraper to crawl an ASP site
  ☆126Updated 5 years ago
• geogas / scrapy-flask-imdb-python
  Python project scraping imdb and web application implemented using Flask.
  ☆54Updated 9 years ago
• feiskyer / scrapy-examples
  Some scrapy and web.py exmaples
  ☆79Updated 7 years ago
• eventuallyc0nsistent / scrapy-programmatically
  Running scrapy spider programmatically.
  ☆47Updated 8 years ago
• leah / python-oauth
  Python OAuth library from Google code.
  ☆175Updated 9 years ago
• pkrumins / xgoogle
  Python library to Google services (google search, google sets, google translate, sponsored links)
  ☆217Updated 5 years ago
• rohithpr / py-web-search
  A Python module to fetch and parse results from different search engines.
  ☆77Updated 6 years ago
• scrapinghub / scrapylib
  Collection of Scrapy utilities (extensions, middlewares, pipelines, etc)
  ☆32Updated 7 years ago
• bbrodriges / pholcidae
  Tiny python web crawler
  ☆169Updated 8 years ago
• realpython / stack-spider
  ☆167Updated 6 years ago
• sunshineatnoon / Scrapy-Amazon-Sqlite
  This is a project crawling backpack information and images from Amazon using python scrapy and store data to sqlite database.
  ☆34Updated 9 years ago
• scrapinghub / scmongo
  MongoDB extensions for Scrapy
  ☆44Updated 10 years ago
• ssteuteville / scrapyz
  "Scrape Easy" - an extension of the Scrapy framework.
  ☆188Updated 8 years ago
• codebox / bayesian-classifier
  A Naive Bayesian Classifier written in Python
  ☆103Updated 8 years ago
• mjhea0 / Scrapy-Samples
  Scrapy examples crawling Craigslist
  ☆199Updated 8 years ago
• mikejs / python-duckduckgo
  A library for querying the Duck Duck Go API
  ☆81Updated 4 years ago
• scrapinghub / webpager
  Paginating the web
  ☆37Updated 11 years ago
• scrapinghub / exporters
  Exporters is an extensible export pipeline library that supports filter, transform and several sources and destinations
  ☆40Updated 9 months ago
• clasense4 / scrapy-bhinneka-crawler
  Scraping bhinneka.com, just for fun
  ☆14Updated 12 years ago
• alexandrevicenzi / fluentmail
  Python SMTP client and Email for Humans™
  ☆82Updated 6 years ago
• mitsuhiko / flask-pastebin
  Example pastebin with websockets, sqlalchemy, facebook connect and a bunch of other buzzwords
  ☆268Updated 8 years ago
• roopeshvaddepally / python-ebay
  Python wrapper for eBay API
  ☆107Updated 3 years ago
• mitsuhiko / bf3-aggregator
  Sourcecode for the bf3 developer news aggregator.
  ☆84Updated 13 years ago
• Alir3z4 / python-sanitize
  Bringing sanity to world of messed-up data
  ☆66Updated 10 years ago
• YahooArchive / yos-social-python
  [dormant] Python SDK
  ☆62Updated 9 years ago
• iurisilvio / bottle-chat
  Asynchronous webchat using Bottle and gevent
  ☆62Updated 13 years ago
• paulproteus / python-scraping-code-samples
  ☆234Updated 4 years ago
• nico / collectiveintelligence-book
  Some code and tests I wrote while working through Toby Segaran's book
  ☆72Updated 8 years ago