Alternatives and similar repositories for awesome-crawler

Users that are interested in awesome-crawler are comparing it to the libraries listed below

• lorien / awesome-web-scraping
  List of libraries, tools and APIs for web scraping and data processing.
  ☆7,454Updated last month
• scrapinghub / portia
  Visual scraping for Scrapy
  ☆9,475Updated last year
• scrapinghub / splash
  Lightweight, scriptable browser as a service with an HTTP API
  ☆4,194Updated last year
• dhamaniasad / HeadlessBrowsers
  A list of (almost) all headless web browsers in existence
  ☆6,455Updated last month
• ChromeDevTools / awesome-chrome-devtools
  Awesome tooling and resources in the Chrome DevTools & DevTools Protocol ecosystem
  ☆6,690Updated last month
• DopplerHQ / awesome-bots
  The most awesome list about bots ⭐️🤖
  ☆4,031Updated last year
• detailyang / awesome-cheatsheet
  awesome cheatsheet
  ☆8,055Updated 5 months ago
• elliotgao2 / toapi
  Every web site provides APIs.
  ☆3,540Updated 3 years ago
• scrapy-plugins / scrapy-splash
  Scrapy+Splash for JavaScript integration
  ☆3,241Updated 9 months ago
• marcobiedermann / search-engine-optimization
  🔍 A helpful checklist/collection of Search Engine Optimization (SEO) tips and techniques.
  ☆2,629Updated 9 months ago
• rekihattori / awesome-programmers
  A list of history's greatest software engineers and tech pioneers
  ☆2,536Updated 4 years ago
• binux / pyspider
  A Powerful Spider(Web Crawler) System in Python.
  ☆16,979Updated last year
• scrapy / scrapyd
  A service daemon to run Scrapy spiders
  ☆3,074Updated this week
• elliotgao2 / gain
  Web crawling framework based on asyncio.
  ☆2,028Updated 6 years ago
• yujiosaka / headless-chrome-crawler
  Distributed crawler powered by Headless Chrome
  ☆5,652Updated 2 years ago
• emijrp / awesome-awesome
  A curated list of awesome curated lists of many topics.
  ☆3,045Updated last year
• lorien / grab
  Web Scraping Framework
  ☆2,431Updated 2 months ago
• oxnr / awesome-bigdata
  A curated list of awesome big data frameworks, ressources and other awesomeness.
  ☆14,045Updated 9 months ago
• gztchan / awesome-design
  🌟 Curated design resources from all over the world.
  ☆16,399Updated last year
• scrapinghub / frontera
  A scalable frontier for web crawlers
  ☆1,320Updated 5 months ago
• alexpate / awesome-design-systems
  💅🏻 ⚒ A collection of awesome design systems
  ☆18,365Updated 4 months ago
• scrapy / scrapely
  A pure-python HTML screen-scraping library
  ☆1,887Updated 3 years ago
• ecthros / uncaptcha
  Defeating Google's audio reCaptcha with 85% accuracy.
  ☆2,815Updated 7 years ago
• AccordBox / awesome-scrapy
  A curated list of awesome packages, articles, and other cool resources from the Scrapy community.
  ☆550Updated 2 years ago
• herrbischoff / awesome-command-line-apps
  Use your terminal shell to do awesome things.
  ☆4,124Updated 4 years ago
• grangier / python-goose
  Html Content / Article Extractor, web scrapping lib in Python
  ☆4,050Updated 3 years ago
• lk-geimfari / awesomo
  Cool open source projects. Choose your project and get involved in Open Source development now.
  ☆9,728Updated last year
• scrapy / scrapy
  Scrapy, a fast high-level web crawling & scraping framework for Python.
  ☆59,029Updated last week
• alebcay / awesome-shell
  A curated list of awesome command-line frameworks, toolkits, guides and gizmos. Inspired by awesome-php.
  ☆35,897Updated 2 months ago
• bayandin / awesome-awesomeness
  A curated list of awesome awesomeness
  ☆33,019Updated last year