bitmakerla / estela
estela, an elastic web scraping cluster 🕸
☆172Updated last week
Related projects ⓘ
Alternatives and complementary repositories for estela
- Scrapy rotation proxy package with advanced functions☆93Updated 2 years ago
- Page Object pattern for Scrapy☆119Updated this week
- Clean, filter and sample URLs to optimize data collection – Python & command-line – Deduplication, spam, content and language filters☆124Updated last week
- A fork of Dragnet that also extract author, headline, date, keywords from context, as well as built in metadata extraction all in one pac…☆234Updated 10 months ago
- Comprehensive wrapper and execution manager for the Chrome browser using the Chrome Debugging Protocol.☆218Updated last year
- Zyte Automatic Extraction integration for Scrapy☆55Updated 2 years ago
- Web scraping Page Objects core library☆95Updated 3 weeks ago
- Common interface for data container classes☆62Updated 3 weeks ago
- 🕶 Awesome list of Scrapy tools and libraries☆55Updated 4 years ago
- Scrapy Extension for monitoring spiders execution.☆533Updated last week
- Home of the Ulixee Open Data Platform☆47Updated this week
- The Web Scraping Club Free Repository☆127Updated last week
- Scrapy extension that gives you all the scraping monitoring, alerting, scheduling, and data validation you will need straight out of the…☆37Updated 3 months ago
- Library that helps use puppeteer in scrapy.☆51Updated last week
- Pyppeteer integration for Scrapy☆60Updated 3 years ago
- Minimal set of tools to conduct stealthy scraping.☆150Updated last year
- 🕷️ Scrapyd is an application for deploying and running Scrapy spiders.☆79Updated 3 weeks ago
- ☆64Updated 7 months ago
- Scrapy project boilerplate done right☆43Updated last month
- A python package for finding e-mails, checking deliverability and more.☆46Updated 6 months ago
- Lightning-Fast, Adaptive Web Scraping for Python☆128Updated this week
- 🎭 Intelligent browser header & fingerprint generator☆228Updated 5 months ago
- Scrapy + Puppeteer☆111Updated 3 years ago
- ☆122Updated last year
- Scrapy download handler that can impersonate browser' TLS signatures or JA3 fingerprints.☆106Updated last month
- Module that extracts structured information from a rendered html site and outputs JSON. HTML to JSON.☆69Updated 3 years ago
- Distributed crawling infrastructure running on top of severless computation, cloud storage (such as S3) and sophisticated queues.☆415Updated last year
- 🦊 Anti-detect browser☆163Updated this week
- A Node.js library to easily manage and rotate a pool of web browsers, using any of the popular browser automation libraries like Puppetee…☆89Updated last year
- A Scrapy middleware to bypass the CloudFlare's anti-bot protection☆106Updated 3 years ago