Alternatives and similar repositories for crawler:

Users that are interested in crawler are comparing it to the libraries listed below

• theanti9 / PyCrawler
  A python web crawler
  ☆212Updated 3 years ago
• omengye / spider
  python Movie Info Web Crawler
  ☆89Updated 7 years ago
• realpython / stack-spider
  ☆167Updated 6 years ago
• manning23 / MSpider
  Spider
  ☆348Updated 2 years ago
• Greyh4t / ProxyPool
  Crawl and validate proxies from Internet
  ☆77Updated 8 years ago
• shelmesky / crawler
  淘宝爬虫原型，基于gevent
  ☆49Updated 11 years ago
• kenshinx / second-spider
  one more spider based on gevent requests pyquery
  ☆55Updated 10 years ago
• Diastro / Zeek
  Python distributed web scrapper and dynamic crawler
  ☆140Updated 7 years ago
• leitro / knowsecSpider2
  知道创宇爬虫题目 持续更新版本
  ☆95Updated 10 years ago
• RobinDavid / Pytesser
  Python wrapper for the tesseract OCR engine. The module is based on OpenCV
  ☆178Updated 7 years ago
• tpeng / weibosearch
  A distributed Sina Weibo Search spider base on Scrapy and Redis.
  ☆143Updated 11 years ago
• yoyzhou / weibo_scrapy
  WEIBO_SCRAPY is a Multi-Threading SINA WEIBO data extraction Framework in Python.
  ☆154Updated 7 years ago
• voliveirajr / seleniumcrawler
  An example using Selenium webdrivers for python and Scrapy framework to create a web scraper to crawl an ASP site
  ☆126Updated 5 years ago
• mekarpeles / captcha-decoder
  An elementary captcha decoder written in python
  ☆157Updated 9 years ago
• kezakez / python-web-crawler
  ☆38Updated 9 years ago
• writepython / web-crawler
  Python Web Crawler with Selenium and PhantomJS
  ☆19Updated 7 years ago
• ZhangBohan / fun_crawler
  Crawl some picture for fun
  ☆162Updated 8 years ago
• pelick / VerticleSearchEngine
  Academic Search Engine using Scrapy, MongoDB, Lucene/Solr, Tika, Struts2, Jquery, Bootstrap, D3, CAS
  ☆98Updated 11 years ago
• xtt129 / seCrawler
  A scrapy project can crawl search result of Google/Bing/Baidu
  ☆76Updated 7 years ago
• Germey / TaobaoMM
  WebSpider of TaobaoMM developed by PySpider
  ☆107Updated 8 years ago
• niwinz / phantompy
  Phantompy is a headless WebKit engine with powerful pythonic api build on top of Qt5 Webkit
  ☆613Updated 7 years ago
• Andrew-liu / scrapy_example
  This repository store some example to learn scrapy better
  ☆176Updated 4 years ago
• cyh24 / multicpu
  Multi-CPU, Multi-Thread. Implemented in Python.
  ☆79Updated 9 years ago
• immzz / zhihu-scrapy
  A scrapy zhihu crawler
  ☆76Updated 6 years ago
• bigsnarfdude / pythonNetworkProgrammingN00B
  HTTP Tester, SMTP Server, DNS grinder, socket scanner, packet sniffer, HTTP, Proxy Cache, port conversion scripts with select, sockets an…
  ☆71Updated 12 years ago
• leitro / ustchacker.com
  USTC Hackers' Club (Categories interest website using tornado and bootstrap) python web
  ☆92Updated 10 years ago
• johnnncodes / note-taking-app
  Source code of the tutorial: Building a CRUD application using Flask (Python framework)
  ☆26Updated 8 years ago
• StephinChou / Pythonspider
  一个简单的python爬虫，原生python+BeautifulSoup
  ☆157Updated 5 years ago
• zrools / spider
  ☆114Updated 8 years ago
• eastrd / HighAnonProxyPool
  A proxy pool that scrapes free anonymous proxies and maintains its proxies' availability.
  ☆93Updated 7 years ago