Alternatives and similar repositories for crawler

Users that are interested in crawler are comparing it to the libraries listed below

• theanti9 / PyCrawler
  A python web crawler
  ☆211Updated 4 years ago
• realpython / stack-spider
  ☆167Updated 6 years ago
• RobinDavid / Pytesser
  Python wrapper for the tesseract OCR engine. The module is based on OpenCV
  ☆177Updated 8 years ago
• Diastro / Zeek
  Python distributed web scrapper and dynamic crawler
  ☆145Updated 8 years ago
• mekarpeles / captcha-decoder
  An elementary captcha decoder written in python
  ☆156Updated 10 years ago
• 4rsh / python
  Developments in Python. — Tools, examples, etc.
  ☆67Updated 4 years ago
• manning23 / MSpider
  Spider
  ☆348Updated 3 years ago
• bcambel / oss.io
  Developers gathering up
  ☆212Updated 8 years ago
• pkrumins / xgoogle
  Python library to Google services (google search, google sets, google translate, sponsored links)
  ☆216Updated 5 years ago
• shelmesky / crawler
  淘宝爬虫原型，基于gevent
  ☆49Updated 12 years ago
• yoyzhou / weibo_scrapy
  WEIBO_SCRAPY is a Multi-Threading SINA WEIBO data extraction Framework in Python.
  ☆154Updated 8 years ago
• bigsnarfdude / pythonNetworkProgrammingN00B
  HTTP Tester, SMTP Server, DNS grinder, socket scanner, packet sniffer, HTTP, Proxy Cache, port conversion scripts with select, sockets an…
  ☆72Updated 12 years ago
• omengye / spider
  python Movie Info Web Crawler
  ☆90Updated 8 years ago
• shadow-box / Violent-Python-Examples
  ☆331Updated 4 years ago
• kenshinx / second-spider
  one more spider based on gevent requests pyquery
  ☆54Updated 11 years ago
• kaidiren / web.py
  web.py 的学习的小程序。。。
  ☆16Updated 8 years ago
• DanMcInerney / elite-proxy-finder
  Finds public elite anonymity proxies and concurrently tests them
  ☆250Updated 8 years ago
• meibenjin / weibo_crawler
  微博搜索结果爬取工具
  ☆27Updated 10 years ago
• qinxuye / cola
  A high-level distributed crawling framework.
  ☆1,506Updated 3 years ago
• orf / cyborg
  Python web scraping framework
  ☆312Updated 7 years ago
• KeithYue / Zhihu_Spider
  Scrapy the Zhihu content and user social network information
  ☆46Updated 11 years ago
• johnnncodes / note-taking-app
  Source code of the tutorial: Building a CRUD application using Flask (Python framework)
  ☆26Updated 9 years ago
• Greyh4t / ProxyPool
  Crawl and validate proxies from Internet
  ☆78Updated 8 years ago
• aitjcize / creepy
  Dead simple web crawler for Python
  ☆39Updated 4 years ago
• rohithpr / py-web-search
  A Python module to fetch and parse results from different search engines.
  ☆79Updated 7 years ago
• 2shou / PhantomjsFetcher
  A python web fetcher using phantomjs to mock browser
  ☆180Updated 7 years ago
• ZhangBohan / fun_crawler
  Crawl some picture for fun
  ☆162Updated 8 years ago
• lllcho / CAPTCHA-breaking
  ☆223Updated 9 years ago
• eastrd / HighAnonProxyPool
  A proxy pool that scrapes free anonymous proxies and maintains its proxies' availability.
  ☆94Updated 7 years ago
• aaronsw / pytorctl
  ☆56Updated last year