Alternatives and similar repositories for awesome-crawler:

Users that are interested in awesome-crawler are comparing it to the libraries listed below

• scrapinghub / portia
  Visual scraping for Scrapy
  ☆9,376Updated 8 months ago
• lorien / awesome-web-scraping
  List of libraries, tools and APIs for web scraping and data processing.
  ☆6,935Updated 2 months ago
• geekan / scrapy-examples
  Multifarious Scrapy examples. Spiders for alexa / amazon / douban / douyu / github / linkedin etc.
  ☆3,228Updated last year
• scrapinghub / splash
  Lightweight, scriptable browser as a service with an HTTP API
  ☆4,133Updated 7 months ago
• DormyMo / SpiderKeeper
  admin ui for scrapy/open source scrapinghub
  ☆2,761Updated last year
• ChromeDevTools / awesome-chrome-devtools
  Awesome tooling and resources in the Chrome DevTools & DevTools Protocol ecosystem
  ☆6,290Updated 2 months ago
• marmelab / awesome-rest
  A collaborative list of great resources about RESTful API architecture, development, test, and performance
  ☆3,697Updated last month
• yujiosaka / headless-chrome-crawler
  Distributed crawler powered by Headless Chrome
  ☆5,559Updated last year
• DopplerHQ / awesome-bots
  The most awesome list about bots ⭐️🤖
  ☆3,907Updated 8 months ago
• elliotgao2 / toapi
  Every web site provides APIs.
  ☆3,523Updated 2 years ago
• scrapy / scrapyd
  A service daemon to run Scrapy spiders
  ☆3,014Updated last month
• lk-geimfari / awesomo
  Cool open source projects. Choose your project and get involved in Open Source development now.
  ☆9,518Updated last year
• binux / pyspider
  A Powerful Spider(Web Crawler) System in Python.
  ☆16,553Updated 10 months ago
• kahun / awesome-sysadmin
  A curated list of amazingly awesome open source sysadmin resources inspired by Awesome PHP.
  ☆23,900Updated 11 months ago
• ramnes / awesome-mongodb
  A curated list of awesome MongoDB resources, libraries, tools and applications
  ☆2,519Updated last month
• transitive-bullshit / awesome-puppeteer
  A curated list of awesome puppeteer resources.
  ☆2,451Updated 8 months ago
• scrapy-plugins / scrapy-splash
  Scrapy+Splash for JavaScript integration
  ☆3,193Updated last month
• jnv / lists
  The definitive list of lists (of lists) curated on GitHub and elsewhere
  ☆10,249Updated 2 months ago
• shlomi-noach / awesome-mysql
  A curated list of awesome MySQL software, libraries, tools and resources
  ☆2,406Updated 2 weeks ago
• dzharii / awesome-elasticsearch
  A curated list of the most important and useful resources about elasticsearch: articles, videos, blogs, tips and tricks, use cases. All a…
  ☆4,946Updated 2 months ago
• luong-komorebi / Awesome-Linux-Software
  🐧 A list of awesome Linux softwares
  ☆22,982Updated last week
• vitalysim / Awesome-Hacking-Resources
  A collection of hacking / penetration testing resources to make you better!
  ☆15,726Updated last year
• chentsulin / awesome-graphql
  Awesome list of GraphQL
  ☆14,689Updated 2 weeks ago
• sbilly / awesome-security
  A collection of awesome software, libraries, documents, books, resources and cools stuffs about security.
  ☆12,886Updated 7 months ago
• dhamaniasad / HeadlessBrowsers
  A list of (almost) all headless web browsers in existence
  ☆6,332Updated last week
• k4m4 / movies-for-hackers
  🎬 A curated list of movies every hacker & cyberpunk must watch.
  ☆10,770Updated 7 months ago
• inputsh / awesome-linux
  A list of awesome projects and resources that make Linux even more awesome.
  ☆4,461Updated 2 years ago
• rekihattori / awesome-programmers
  A list of history's greatest software engineers and tech pioneers
  ☆2,494Updated 3 years ago
• oxnr / awesome-bigdata
  A curated list of awesome big data frameworks, ressources and other awesomeness.
  ☆13,509Updated last month
• gztchan / awesome-design
  🌟 Curated design resources from all over the world.
  ☆15,889Updated 8 months ago