Alternatives and similar repositories for crawler

Users that are interested in crawler are comparing it to the libraries listed below

• theanti9 / PyCrawler
  A python web crawler
  ☆212Updated 3 years ago
• shelmesky / crawler
  淘宝爬虫原型，基于gevent
  ☆49Updated 12 years ago
• leitro / ustchacker.com
  USTC Hackers' Club (Categories interest website using tornado and bootstrap) python web
  ☆92Updated 10 years ago
• omengye / spider
  python Movie Info Web Crawler
  ☆89Updated 8 years ago
• Greyh4t / ProxyPool
  Crawl and validate proxies from Internet
  ☆77Updated 8 years ago
• yoyzhou / weibo_scrapy
  WEIBO_SCRAPY is a Multi-Threading SINA WEIBO data extraction Framework in Python.
  ☆154Updated 7 years ago
• ZhangBohan / fun_crawler
  Crawl some picture for fun
  ☆162Updated 8 years ago
• manning23 / MSpider
  Spider
  ☆347Updated 2 years ago
• realpython / stack-spider
  ☆167Updated 6 years ago
• KeithYue / Zhihu_Spider
  Scrapy the Zhihu content and user social network information
  ☆46Updated 11 years ago
• weizetao / spider-roach
  分布式定向抓取集群
  ☆71Updated 7 years ago
• Andrew-liu / scrapy_example
  This repository store some example to learn scrapy better
  ☆176Updated 4 years ago
• tpeng / weibosearch
  A distributed Sina Weibo Search spider base on Scrapy and Redis.
  ☆145Updated 12 years ago
• mekarpeles / captcha-decoder
  An elementary captcha decoder written in python
  ☆155Updated 9 years ago
• leitro / knowsecSpider2
  知道创宇爬虫题目 持续更新版本
  ☆94Updated 10 years ago
• qinxuye / cola
  A high-level distributed crawling framework.
  ☆1,507Updated 2 years ago
• writepython / web-crawler
  Python Web Crawler with Selenium and PhantomJS
  ☆19Updated 8 years ago
• StephinChou / Pythonspider
  一个简单的python爬虫，原生python+BeautifulSoup
  ☆157Updated 6 years ago
• xelzmm / proxy_server_crawler
  an awesome public proxy server crawler based on scrapy framework
  ☆95Updated 8 years ago
• chensoul / scrapy-zhihu-github
  scrapy examples for crawling zhihu and github
  ☆225Updated 2 years ago
• Germey / TaobaoMM
  WebSpider of TaobaoMM developed by PySpider
  ☆107Updated 8 years ago
• ericls / tushe
  A web based image hosting, viewing and sharing service build on top of Flask.
  ☆110Updated 9 years ago
• voliveirajr / seleniumcrawler
  An example using Selenium webdrivers for python and Scrapy framework to create a web scraper to crawl an ASP site
  ☆127Updated 6 years ago
• phith0n / python-xss-filter
  Based on native Python module HTMLParser purifier of HTML, To Clear all javascript in html
  ☆115Updated 8 years ago
• atupal / webqq
  urllib2模拟登陆webqq接收发消息， 还有一个cli版本的在github上
  ☆56Updated 11 years ago
• ericls / FairyBBS
  A Forum(BBS) based on Django [Discontinued]
  ☆140Updated 8 years ago
• zrools / spider
  ☆113Updated 9 years ago
• RobinDavid / Pytesser
  Python wrapper for the tesseract OCR engine. The module is based on OpenCV
  ☆177Updated 7 years ago
• 2shou / PhantomjsFetcher
  A python web fetcher using phantomjs to mock browser
  ☆180Updated 7 years ago
• dvska / requesocks
  Python HTTP Requests for Humans™ (renamed fork of github.com/foxx/requests == requests working with socks proxy (i.e tor)).
  ☆40Updated 7 years ago