Alternatives and similar repositories for awesome-crawler

Users that are interested in awesome-crawler are comparing it to the libraries listed below

• scrapinghub / portia
  Visual scraping for Scrapy
  ☆9,474Updated last year
• geekan / scrapy-examples
  Multifarious Scrapy examples. Spiders for alexa / amazon / douban / douyu / github / linkedin etc.
  ☆3,259Updated 2 years ago
• lorien / awesome-web-scraping
  List of libraries, tools and APIs for web scraping and data processing.
  ☆7,668Updated 2 months ago
• rekihattori / awesome-programmers
  A list of history's greatest software engineers and tech pioneers
  ☆2,540Updated 4 years ago
• ChromeDevTools / awesome-chrome-devtools
  Awesome tooling and resources in the Chrome DevTools & DevTools Protocol ecosystem
  ☆6,719Updated 2 months ago
• mezod / awesome-indie
  Resources for independent developers to make money
  ☆10,642Updated last year
• scrapy / scrapyd
  A service daemon to run Scrapy spiders
  ☆3,078Updated 3 weeks ago
• yujiosaka / headless-chrome-crawler
  Distributed crawler powered by Headless Chrome
  ☆5,673Updated 2 years ago
• scrapinghub / splash
  Lightweight, scriptable browser as a service with an HTTP API
  ☆4,196Updated last year
• detailyang / awesome-cheatsheet
  awesome cheatsheet
  ☆8,096Updated 6 months ago
• dhamaniasad / HeadlessBrowsers
  A list of (almost) all headless web browsers in existence
  ☆6,465Updated 2 months ago
• binux / pyspider
  A Powerful Spider(Web Crawler) System in Python.
  ☆17,001Updated last year
• DopplerHQ / awesome-bots
  The most awesome list about bots ⭐️🤖
  ☆4,038Updated last year
• scrapy-plugins / scrapy-splash
  Scrapy+Splash for JavaScript integration
  ☆3,240Updated 10 months ago
• elliotgao2 / toapi
  Every web site provides APIs.
  ☆3,542Updated 3 years ago
• grangier / python-goose
  Html Content / Article Extractor, web scrapping lib in Python
  ☆4,052Updated 3 years ago
• marmelab / awesome-rest
  A collaborative list of great resources about RESTful API architecture, development, test, and performance
  ☆3,822Updated 4 months ago
• Zheaoli / awesome-coins
  ₿ A guide (for humans!) to cryto-currencies and their algos.
  ☆4,043Updated 2 years ago
• lorien / grab
  Web Scraping Framework
  ☆2,441Updated 2 months ago
• qinxuye / cola
  A high-level distributed crawling framework.
  ☆1,507Updated 3 years ago
• oxnr / awesome-analytics
  A curated list of analytics frameworks, software and other tools.
  ☆4,215Updated last week
• emijrp / awesome-awesome
  A curated list of awesome curated lists of many topics.
  ☆3,054Updated last year
• dzharii / awesome-elasticsearch
  A curated list of the most important and useful resources about elasticsearch: articles, videos, blogs, tips and tricks, use cases. All a…
  ☆5,012Updated 7 months ago
• ramnes / awesome-mongodb
  A curated list of awesome MongoDB resources, libraries, tools and applications
  ☆2,621Updated last month
• mfornos / awesome-microservices
  A curated list of Microservice Architecture related principles and technologies.
  ☆14,022Updated 10 months ago
• k4m4 / movies-for-hackers
  🎬 A curated list of movies every hacker & cyberpunk must watch.
  ☆11,538Updated last year
• thibmaek / awesome-raspberry-pi
  📝 A curated list of awesome Raspberry Pi tools, projects, images and resources
  ☆15,566Updated last month
• marcobiedermann / search-engine-optimization
  🔍 A helpful checklist/collection of Search Engine Optimization (SEO) tips and techniques.
  ☆2,641Updated 9 months ago
• fcambus / nginx-resources
  A collection of resources covering Nginx, Nginx + Lua, OpenResty and Tengine
  ☆3,715Updated 2 years ago
• moul / awesome-ssh
  A curated list of SSH resources.
  ☆2,708Updated 2 years ago