bitmakerla / estela
estela, an elastic web scraping cluster 🕸
☆180Updated 2 months ago
Alternatives and similar repositories for estela
Users that are interested in estela are comparing it to the libraries listed below
Sorting:
- Scrapy rotation proxy package with advanced functions☆95Updated 2 years ago
- A fork of Dragnet that also extract author, headline, date, keywords from context, as well as built in metadata extraction all in one pac…☆276Updated last year
- Scrapy download handler that can impersonate browser' TLS signatures or JA3 fingerprints.☆154Updated this week
- Page Object pattern for Scrapy☆121Updated this week
- The Web Scraping Club Free Repository☆141Updated 2 weeks ago
- Scrapy extension that gives you all the scraping monitoring, alerting, scheduling, and data validation you will need straight out of the…☆36Updated 9 months ago
- Minimal set of tools to conduct stealthy scraping.☆156Updated 2 years ago
- ☆74Updated 3 months ago
- Distributed crawling infrastructure running on top of severless computation, cloud storage (such as S3) and sophisticated queues.☆430Updated 2 years ago
- A test suite of common scraper detection techniques. See how detectable your scraper stack is.☆137Updated 2 years ago
- 🎭 Intelligent browser header & fingerprint generator☆538Updated last month
- Library that helps use puppeteer in scrapy.☆52Updated last month
- ☆131Updated last year
- Home of the Ulixee Open Data Platform☆50Updated 5 months ago
- playwright stealth☆675Updated 9 months ago
- A blazing-fast Python HTTP Client with TLS fingerprint☆379Updated this week
- Web scraping Page Objects core library☆99Updated 3 months ago
- A Node.js library to easily manage and rotate a pool of web browsers, using any of the popular browser automation libraries like Puppetee…☆94Updated 2 years ago
- Patching CDP (Chrome DevTools Protocol) leaks on OS level. Easy to use with Playwright, Selenium, and other web automation tools.☆116Updated 8 months ago
- Browser fingerprint data generator☆57Updated last month
- Scrapyd on container infrastructure☆14Updated last month
- A simple HTML content extractor in Python. Can be run as a wrapper for Mozilla's Readability.js package or in pure-python mode.☆303Updated 5 months ago
- Clean, filter and sample URLs to optimize data collection – Python & command-line – Deduplication, spam, content and language filters☆137Updated 4 months ago
- A python based HTML to text conversion library, command line client and Web service.☆303Updated last month
- Module that extracts structured information from a rendered html site and outputs JSON. HTML to JSON.☆70Updated 3 years ago
- The Architecture of a Web Crawler: Building a Google-Inspired Distributed Web Crawler☆115Updated 5 months ago
- A suite of tools for protecting the web's open knowledge.☆127Updated 7 months ago
- Use AWS Lambda functions as a proxy pool to scrape web pages.☆131Updated last year
- Zyte Automatic Extraction integration for Scrapy☆56Updated 3 years ago
- Get structured JSON data from any page.☆175Updated last year