lorien / awesome-web-scrapingLinks
List of libraries, tools and APIs for web scraping and data processing.
☆7,066Updated 6 months ago
Alternatives and similar repositories for awesome-web-scraping
Users that are interested in awesome-web-scraping are comparing it to the libraries listed below
Sorting:
- A collection of awesome web crawler,spider in different languages☆6,847Updated last year
- Web Scraping Framework☆2,404Updated last year
- Lightweight, scriptable browser as a service with an HTTP API☆4,161Updated 11 months ago
- A list of (almost) all headless web browsers in existence☆6,393Updated 3 months ago
- Visual scraping for Scrapy☆9,430Updated last year
- The definitive list of lists (of lists) curated on GitHub and elsewhere☆10,444Updated last month
- A a curated list of curated lists of awesome lists.☆2,027Updated last year
- The most awesome list about bots ⭐️🤖☆3,968Updated last year
- Scrapy+Splash for JavaScript integration☆3,214Updated 4 months ago
- A list of scrapers from around the web.☆677Updated 5 months ago
- A pure-python HTML screen-scraping library☆1,875Updated 3 years ago
- A curated list of awesome open source or open source licensed documents, guides, books.☆2,071Updated 2 years ago
- A curated list of awesome packages, articles, and other cool resources from the Scrapy community.☆551Updated 2 years ago
- 🔍 A helpful checklist/collection of Search Engine Optimization (SEO) tips and techniques.☆2,562Updated 4 months ago
- The web scraping open project repository aims to share knowledge and experiences about web scraping with Python☆1,651Updated last year
- A curated list of Web Performance Optimization. Everyone can contribute here!☆8,562Updated 4 months ago
- Design and development guides☆2,291Updated last week
- A service daemon to run Scrapy spiders☆3,043Updated this week
- A collaborative list of great resources about RESTful API architecture, development, test, and performance☆3,763Updated 4 months ago
- Resources about public speaking☆1,801Updated last year
- A curated list of awesome curated lists of many topics.☆2,981Updated 11 months ago
- Awesome tooling and resources in the Chrome DevTools & DevTools Protocol ecosystem☆6,452Updated 6 months ago
- Resources for independent developers to make money☆10,364Updated last year
- use multiple proxies with Scrapy☆763Updated 3 years ago
- Distributed crawler powered by Headless Chrome☆5,582Updated 2 years ago
- An Awesome List for getting started with web archiving☆2,307Updated 3 months ago
- Declarative web scraping☆5,829Updated this week
- Compiled list of links from "Ask HN: Where can I post my startup to get beta users?"☆6,274Updated 6 months ago
- A curated list of awesome minimalist frameworks (simple and lightweight).☆3,619Updated 2 weeks ago
- A curated collection of awesome Regex libraries, tools, frameworks and software☆1,724Updated 8 months ago