Alternatives and similar repositories for python-webcrawler

Users that are interested in python-webcrawler are comparing it to the libraries listed below

• andrewjw / celery-crawler
  A Django based search engine powered by CouchDB, celery and whoosh.
  ☆48Updated 10 years ago
• suryasev / unofficial-google-trends-api
  Python-based API that uses the http site to download Google Trends data
  ☆218Updated 5 years ago
• voliveirajr / seleniumcrawler
  An example using Selenium webdrivers for python and Scrapy framework to create a web scraper to crawl an ASP site
  ☆127Updated 6 years ago
• mjhea0 / Scrapy-Samples
  Scrapy examples crawling Craigslist
  ☆201Updated 9 years ago
• pkrumins / xgoogle
  Python library to Google services (google search, google sets, google translate, sponsored links)
  ☆216Updated 6 years ago
• realpython / stack-spider
  ☆167Updated 7 years ago
• feiskyer / scrapy-examples
  Some scrapy and web.py exmaples
  ☆79Updated 8 years ago
• scrapy-plugins / scrapy-monkeylearn
  A Scrapy pipeline to categorize items using MonkeyLearn
  ☆38Updated 8 years ago
• paulproteus / python-scraping-code-samples
  ☆232Updated 5 years ago
• junekihong / linkedInScraper
  Scrapes public information off of LinkedIn
  ☆113Updated 9 years ago
• chrisspen / webarticle2text
  [DEPRECATED] A script to extract the main article text from an arbitrary webpage.
  ☆87Updated 8 years ago
• bitly / bitly-api-python
  python library to the bitly api
  ☆242Updated 4 years ago
• cantabular / scraperwiki-python
  ScraperWiki Python library for scraping and saving data; in maintenance mode
  ☆158Updated this week
• scrapy / loginform
  Fill HTML login forms automatically
  ☆276Updated last year
• clintecker / python-googleanalytics
  A python client for accessing the Google Analytics API
  ☆248Updated 4 years ago
• theanti9 / PyCrawler
  A python web crawler
  ☆213Updated 4 years ago
• gtaylor / paypal-python
  Unofficial implementation of the now-old PayPal NVP APIs in Python
  ☆153Updated 7 years ago
• nicodjimenez / bus_catchers
  Python scripts for scraping bus ticket data from the websites of BoltBus, Greyhound, Megabus, GoBus, Amtrak, Peterpan, and EasternTravel.
  ☆39Updated 5 years ago
• edmondburnett / twitter-text-python
  Twitter text processing library (auto linking and extraction of usernames, lists and hashtags).
  ☆178Updated last year
• corywalker / selenium-crawler
  Sometimes sites make crawling hard. Selenium-crawler uses selenium automation to fix that.
  ☆126Updated 12 years ago
• rohithpr / py-web-search
  A Python module to fetch and parse results from different search engines.
  ☆79Updated 7 years ago
• vgel / summarize.py
  A python script for summarizing articles using nltk
  ☆548Updated 9 years ago
• sciyoshi / pyfacebook
  PyFacebook
  ☆571Updated 6 years ago
• lucjon / Py-StackExchange
  A Python binding for the StackExchange API
  ☆232Updated 4 years ago
• roopeshvaddepally / python-ebay
  Python wrapper for eBay API
  ☆110Updated 4 years ago
• ssteuteville / scrapyz
  "Scrape Easy" - an extension of the Scrapy framework.
  ☆186Updated 9 years ago
• japerk / nltk-trainer
  Train NLTK objects with zero code
  ☆744Updated 5 years ago
• geogas / scrapy-flask-imdb-python
  Python project scraping imdb and web application implemented using Flask.
  ☆54Updated 10 years ago
• SlapBot / newsapi
  A python wrapper for News API.
  ☆72Updated 7 years ago
• thraxil / restclient
  official github mirror of http://code.google.com/p/microapps/wiki/Restclient
  ☆36Updated 9 years ago