Alternatives and similar repositories for awesome-crawler

Users that are interested in awesome-crawler are comparing it to the libraries listed below

• lorien / awesome-web-scraping
  List of libraries, tools and APIs for web scraping and data processing.
  ☆7,372Updated this week
• ChromeDevTools / awesome-chrome-devtools
  Awesome tooling and resources in the Chrome DevTools & DevTools Protocol ecosystem
  ☆6,614Updated 2 weeks ago
• scrapinghub / portia
  Visual scraping for Scrapy
  ☆9,457Updated last year
• dhamaniasad / HeadlessBrowsers
  A list of (almost) all headless web browsers in existence
  ☆6,438Updated this week
• scrapinghub / splash
  Lightweight, scriptable browser as a service with an HTTP API
  ☆4,178Updated last year
• binux / pyspider
  A Powerful Spider(Web Crawler) System in Python.
  ☆16,922Updated last year
• DopplerHQ / awesome-bots
  The most awesome list about bots ⭐️🤖
  ☆4,005Updated last year
• scrapy / scrapyd
  A service daemon to run Scrapy spiders
  ☆3,064Updated last month
• geekan / scrapy-examples
  Multifarious Scrapy examples. Spiders for alexa / amazon / douban / douyu / github / linkedin etc.
  ☆3,252Updated last year
• detailyang / awesome-cheatsheet
  awesome cheatsheet
  ☆7,992Updated 4 months ago
• yujiosaka / headless-chrome-crawler
  Distributed crawler powered by Headless Chrome
  ☆5,600Updated 2 years ago
• scrapy-plugins / scrapy-splash
  Scrapy+Splash for JavaScript integration
  ☆3,229Updated 8 months ago
• lorien / grab
  Web Scraping Framework
  ☆2,421Updated 3 weeks ago
• marcobiedermann / search-engine-optimization
  🔍 A helpful checklist/collection of Search Engine Optimization (SEO) tips and techniques.
  ☆2,599Updated 7 months ago
• rekihattori / awesome-programmers
  A list of history's greatest software engineers and tech pioneers
  ☆2,531Updated 4 years ago
• scrapoxy / scrapoxy
  Scrapoxy is a super proxies manager that orchestrates all your proxies into one place, rather than spreading management across multiple s…
  ☆2,370Updated 2 months ago
• AccordBox / awesome-scrapy
  A curated list of awesome packages, articles, and other cool resources from the Scrapy community.
  ☆550Updated 2 years ago
• mezod / awesome-indie
  Resources for independent developers to make money
  ☆10,539Updated last year
• awesome-bootstrap-org / awesome-bootstrap
  ✨ Awesome - A curated list of amazing Bootstrap tools and themes.
  ☆1,404Updated last year
• oxnr / awesome-bigdata
  A curated list of awesome big data frameworks, ressources and other awesomeness.
  ☆13,927Updated 8 months ago
• emijrp / awesome-awesome
  A curated list of awesome curated lists of many topics.
  ☆3,024Updated last year
• oxnr / awesome-analytics
  A curated list of analytics frameworks, software and other tools.
  ☆4,150Updated last year
• teles / awesome-seo
  A curated list of SEO (Search Engine Optimization) links.
  ☆697Updated last week
• qinxuye / cola
  A high-level distributed crawling framework.
  ☆1,507Updated 3 years ago
• herrbischoff / awesome-command-line-apps
  Use your terminal shell to do awesome things.
  ☆4,092Updated 4 years ago
• MontFerret / ferret
  Declarative web scraping
  ☆5,877Updated last month
• elliotgao2 / toapi
  Every web site provides APIs.
  ☆3,537Updated 3 years ago
• davidsonfellipe / awesome-wpo
  A curated list of Web Performance Optimization. Everyone can contribute here!
  ☆8,664Updated 2 months ago
• scrapy / scrapy
  Scrapy, a fast high-level web crawling & scraping framework for Python.
  ☆58,594Updated last week
• fcambus / nginx-resources
  A collection of resources covering Nginx, Nginx + Lua, OpenResty and Tengine
  ☆3,694Updated 2 years ago