bitmakerla / estela
estela, an elastic web scraping cluster 🕸
☆180Updated last month
Alternatives and similar repositories for estela:
Users that are interested in estela are comparing it to the libraries listed below
- Page Object pattern for Scrapy☆121Updated 2 months ago
- Scrapy rotation proxy package with advanced functions☆95Updated 2 years ago
- Scrapy download handler that can impersonate browser' TLS signatures or JA3 fingerprints.☆145Updated last month
- ☆74Updated 2 months ago
- Web scraping Page Objects core library☆99Updated 2 months ago
- The Web Scraping Club Free Repository☆139Updated 5 months ago
- Scrapy Extension for monitoring spiders execution.☆540Updated last week
- A fork of Dragnet that also extract author, headline, date, keywords from context, as well as built in metadata extraction all in one pac…☆275Updated last year
- Library that helps use puppeteer in scrapy.☆52Updated last week
- Minimal set of tools to conduct stealthy scraping.☆156Updated 2 years ago
- Home of the Ulixee Open Data Platform☆50Updated 4 months ago
- Super Fast, Super Anti-Detect, and Super Intuitive Web Driver☆60Updated last week
- Zyte Automatic Extraction integration for Scrapy☆56Updated 3 years ago
- A fork of https://github.com/AtuboDad/playwright_stealth☆83Updated 3 weeks ago
- Module that extracts structured information from a rendered html site and outputs JSON. HTML to JSON.☆70Updated 3 years ago
- A test suite of common scraper detection techniques. See how detectable your scraper stack is.☆137Updated 2 years ago
- A blazing fast, async-first, undetectable webscraping/web automation framework based on ultrafunkamsterdam/nodriver. Now with Docker supp…☆370Updated this week
- 🎭 Intelligent browser header & fingerprint generator☆508Updated last month
- Patching CDP (Chrome DevTools Protocol) leaks on OS level. Easy to use with Playwright, Selenium, and other web automation tools.☆112Updated 8 months ago
- Scrapy extension that gives you all the scraping monitoring, alerting, scheduling, and data validation you will need straight out of the…☆36Updated 9 months ago
- A drop-in replacement for playwright-python patched with rebrowser-patches. It allows to pass modern automation detection tests.☆63Updated 4 months ago
- use multiple proxies with Scrapy☆756Updated 2 years ago
- Pyppeteer integration for Scrapy☆58Updated 4 years ago
- Zyte API integration for Scrapy☆38Updated last week
- Distributed crawling infrastructure running on top of severless computation, cloud storage (such as S3) and sophisticated queues.☆429Updated 2 years ago
- A blazing-fast Python HTTP Client with TLS fingerprint☆287Updated this week
- 🔮 Vindicate non-organic web traffic via MITM proxy☆54Updated 9 months ago
- Scrapy + Puppeteer☆111Updated 3 years ago
- Clean, filter and sample URLs to optimize data collection – Python & command-line – Deduplication, spam, content and language filters☆137Updated 3 months ago
- playwright stealth☆656Updated 8 months ago