Alternatives and similar repositories for python-webcrawler

Users that are interested in python-webcrawler are comparing it to the libraries listed below

• andrewjw / celery-crawler
  A Django based search engine powered by CouchDB, celery and whoosh.
  ☆49Updated 9 years ago
• voliveirajr / seleniumcrawler
  An example using Selenium webdrivers for python and Scrapy framework to create a web scraper to crawl an ASP site
  ☆128Updated 6 years ago
• feiskyer / scrapy-examples
  Some scrapy and web.py exmaples
  ☆79Updated 8 years ago
• theanti9 / PyCrawler
  A python web crawler
  ☆212Updated 4 years ago
• pkrumins / xgoogle
  Python library to Google services (google search, google sets, google translate, sponsored links)
  ☆216Updated 6 years ago
• scrapinghub / testspiders
  Useful test spiders for Scrapy
  ☆185Updated 5 years ago
• ryancerf / scrapy-sqlitem
  Scrapy extension to write items using sqlalchemy models
  ☆37Updated 8 years ago
• volker48 / python-concurrency
  Code examples from my toptal engineering blog article
  ☆156Updated 2 years ago
• roopeshvaddepally / python-ebay
  Python wrapper for eBay API
  ☆108Updated 3 years ago
• mjhea0 / Scrapy-Samples
  Scrapy examples crawling Craigslist
  ☆199Updated 9 years ago
• jjlee / mechanize
  Stateful programmatic web browsing in Python, after Andy Lester's Perl module WWW::Mechanize .
  ☆615Updated 8 years ago
• paltman-archive / django-pdf
  Manage uploaded documents (pdfs) with backend cloud processing of the pdfs into individual pngs per page
  ☆103Updated 11 years ago
• laurentluce / python-algorithms
  Algorithms implemented in Python
  ☆282Updated 2 years ago
• scrapinghub / scrapylib
  Collection of Scrapy utilities (extensions, middlewares, pipelines, etc)
  ☆32Updated 7 years ago
• scrapy / loginform
  Fill HTML login forms automatically
  ☆276Updated last year
• brandicted / scrapy-webdriver
  ☆143Updated 9 years ago
• leah / python-oauth
  Python OAuth library from Google code.
  ☆176Updated 9 years ago
• rohithpr / py-web-search
  A Python module to fetch and parse results from different search engines.
  ☆79Updated 7 years ago
• lucjon / Py-StackExchange
  A Python binding for the StackExchange API
  ☆232Updated 4 years ago
• jmg / crawley
  Pythonic Crawling / Scraping Framework based on Non Blocking I/O operations.
  ☆189Updated 2 years ago
• scrapinghub / python-scrapinghub
  A client interface for Scrapinghub's API
  ☆205Updated last month
• bitly / bitly-api-python
  python library to the bitly api
  ☆243Updated 4 years ago
• suryasev / unofficial-google-trends-api
  Python-based API that uses the http site to download Google Trends data
  ☆218Updated 5 years ago
• gak / pygooglechart
  pygooglechart is a complete Python wrapper for the Google Chart API.
  ☆197Updated 3 years ago
• corywalker / selenium-crawler
  Sometimes sites make crawling hard. Selenium-crawler uses selenium automation to fix that.
  ☆125Updated 12 years ago
• gtaylor / paypal-python
  Unofficial implementation of the now-old PayPal NVP APIs in Python
  ☆153Updated 7 years ago
• scrapy / w3lib
  Python library of web-related functions
  ☆411Updated 2 months ago
• junekihong / linkedInScraper
  Scrapes public information off of LinkedIn
  ☆111Updated 9 years ago
• paulproteus / python-scraping-code-samples
  ☆233Updated 5 years ago
• nicodjimenez / bus_catchers
  Python scripts for scraping bus ticket data from the websites of BoltBus, Greyhound, Megabus, GoBus, Amtrak, Peterpan, and EasternTravel.
  ☆38Updated 5 years ago