Alternatives and similar repositories for awesome-web-scraping:

Users that are interested in awesome-web-scraping are comparing it to the libraries listed below

• lorien / grab
  Web Scraping Framework
  ☆2,401Updated last year
• BruceDone / awesome-crawler
  A collection of awesome web crawler,spider in different languages
  ☆6,679Updated 9 months ago
• scrapinghub / portia
  Visual scraping for Scrapy
  ☆9,376Updated 8 months ago
• geekan / scrapy-examples
  Multifarious Scrapy examples. Spiders for alexa / amazon / douban / douyu / github / linkedin etc.
  ☆3,228Updated last year
• scrapy-plugins / scrapy-splash
  Scrapy+Splash for JavaScript integration
  ☆3,193Updated last month
• scrapinghub / splash
  Lightweight, scriptable browser as a service with an HTTP API
  ☆4,133Updated 7 months ago
• jnv / lists
  The definitive list of lists (of lists) curated on GitHub and elsewhere
  ☆10,249Updated 2 months ago
• scrapy / scrapyd
  A service daemon to run Scrapy spiders
  ☆3,014Updated last month
• jmcarp / robobrowser
  ☆3,704Updated 4 years ago
• AccordBox / awesome-scrapy
  A curated list of awesome packages, articles, and other cool resources from the Scrapy community.
  ☆543Updated 2 years ago
• scrapy / scrapely
  A pure-python HTML screen-scraping library
  ☆1,870Updated 2 years ago
• DormyMo / SpiderKeeper
  admin ui for scrapy/open source scrapinghub
  ☆2,761Updated last year
• grangier / python-goose
  Html Content / Article Extractor, web scrapping lib in Python
  ☆4,023Updated 3 years ago
• kahun / awesome-sysadmin
  A curated list of amazingly awesome open source sysadmin resources inspired by Awesome PHP.
  ☆23,900Updated 11 months ago
• oxnr / awesome-analytics
  A curated list of analytics frameworks, software and other tools.
  ☆3,998Updated 10 months ago
• kirang89 / pycrumbs
  Bits and bytes of Python from the Internet
  ☆3,228Updated last year
• scrapinghub / frontera
  A scalable frontier for web crawlers
  ☆1,307Updated last month
• bayandin / awesome-awesomeness
  A curated list of awesome awesomeness
  ☆32,434Updated 9 months ago
• aivarsk / scrapy-proxies
  Random proxy middleware for Scrapy
  ☆1,667Updated 5 years ago
• NikolaiT / GoogleScraper
  A Python module to scrape several search engines (like Google, Yandex, Bing, Duckduckgo, ...). Including asynchronous networking support.
  ☆2,679Updated 3 years ago
• transitive-bullshit / awesome-puppeteer
  A curated list of awesome puppeteer resources.
  ☆2,451Updated 8 months ago
• my8100 / scrapydweb
  Web app for Scrapyd cluster management, Scrapy log analysis & visualization, Auto packaging, Timer tasks, Monitor & Alert, and Mobile UI.…
  ☆3,250Updated last month
• MechanicalSoup / MechanicalSoup
  A Python library for automating interaction with websites.
  ☆4,729Updated last month
• binux / pyspider
  A Powerful Spider(Web Crawler) System in Python.
  ☆16,553Updated 10 months ago
• TeamHG-Memex / scrapy-rotating-proxies
  use multiple proxies with Scrapy
  ☆754Updated 2 years ago
• ChromeDevTools / awesome-chrome-devtools
  Awesome tooling and resources in the Chrome DevTools & DevTools Protocol ecosystem
  ☆6,290Updated 2 months ago
• t3chnoboy / awesome-awesome-awesome
  A a curated list of curated lists of awesome lists.
  ☆1,983Updated last year
• cjbarber / ToolsOfTheTrade
  Tools of The Trade, from Hacker News.
  ☆16,699Updated 7 months ago
• emijrp / awesome-awesome
  A curated list of awesome curated lists of many topics.
  ☆2,902Updated 7 months ago
• yujiosaka / headless-chrome-crawler
  Distributed crawler powered by Headless Chrome
  ☆5,559Updated last year