NikolaiT / struktur
Module that extracts structured information from a rendered html site and outputs JSON. HTML to JSON.
☆69Updated 3 years ago
Alternatives and similar repositories for struktur:
Users that are interested in struktur are comparing it to the libraries listed below
- 🧱 A uniform template to use as a foundation for Puppeteer bot construction.☆65Updated 3 years ago
- Apify actor that opens a web page in headless Chrome and analyzes the HTML and JavaScript objects, looks for schema.org microdata and JSO…☆150Updated last year
- A test suite of common scraper detection techniques. See how detectable your scraper stack is.☆136Updated 2 years ago
- 🛡🎭 A conceptual patch which modifies some vanilla puppeteer files to decrease detection rates.☆50Updated 3 years ago
- Minimal set of tools to conduct stealthy scraping.☆153Updated last year
- NodeJs package for generating browser-like headers.☆65Updated 2 years ago
- A Node.js library to easily manage and rotate a pool of web browsers, using any of the popular browser automation libraries like Puppetee…☆92Updated 2 years ago
- DFPM is a browser extension for detecting browser fingerprinting.☆114Updated 2 years ago
- Automatically extracts structured information from webpages☆107Updated 2 years ago
- Cloud crawler functions for scrapeulous☆44Updated 3 years ago
- 🔐 Tooling to access Puppeteer's internal Isolated World.☆21Updated 3 years ago
- Distributed crawling infrastructure running on top of severless computation, cloud storage (such as S3) and sophisticated queues.☆422Updated 2 years ago
- ☆109Updated 10 months ago
- Add-ons for Playwright: adblocker, stealth mode☆46Updated 3 years ago
- 🕵♂ Bot detection tests for Puppeteer. Hide and seek!☆85Updated last year
- Bypassing bot detection checks with Puppeteer.☆94Updated 4 years ago
- Proxies Puppeteer Page requests.☆204Updated 5 months ago
- A complimentary proxy to help to use SPM with headless browsers☆109Updated last year
- Advanced Node proxy checker (node proxy verifier, node proxy tester) with socks and https support☆109Updated 2 years ago
- A simple puppeteer wrapper to enable useful plugins with ease☆55Updated this week
- How to detect puppeteer with 100% accuracy☆107Updated 3 years ago
- Fingerprinting script of Fingerprint-Scanner☆241Updated 10 months ago
- Scrapy rotation proxy package with advanced functions☆94Updated 2 years ago
- A web page that compiles methods used by Akamai, Datadome, and other bot detection solutions and WAF (Web Application Firewall) to identi…☆43Updated 3 years ago
- ☆25Updated 3 years ago
- ☆13Updated last year
- Dead simple cron service for making HTTP calls on a regular schedule.☆14Updated 4 years ago
- Flatten, format, and export any JSON-like data to CSV (or any other string output).☆17Updated 3 years ago
- JavaScript code of many commercial bot detectors/fingerprinting services and string deobfuscators for them if applicable.☆121Updated 3 years ago
- Chromium / Puppeteer site crawler☆48Updated 4 years ago