NikolaiT / struktur
Module that extracts structured information from a rendered html site and outputs JSON. HTML to JSON.
β69Updated 3 years ago
Alternatives and similar repositories for struktur:
Users that are interested in struktur are comparing it to the libraries listed below
- 𧱠A uniform template to use as a foundation for Puppeteer bot construction.β65Updated 3 years ago
- Automatically extracts structured information from webpagesβ107Updated 2 years ago
- A test suite of common scraper detection techniques. See how detectable your scraper stack is.β136Updated 2 years ago
- Minimal set of tools to conduct stealthy scraping.β154Updated last year
- Bypassing bot detection checks with Puppeteer.β93Updated 4 years ago
- NodeJs package for generating browser-like headers.β67Updated 2 years ago
- Cloud crawler functions for scrapeulousβ45Updated 4 years ago
- A Node.js library to easily manage and rotate a pool of web browsers, using any of the popular browser automation libraries like Puppeteeβ¦β94Updated 2 years ago
- π‘π A conceptual patch which modifies some vanilla puppeteer files to decrease detection rates.β50Updated 3 years ago
- DFPM is a browser extension for detecting browser fingerprinting.β116Updated 2 years ago
- Apify actor that opens a web page in headless Chrome and analyzes the HTML and JavaScript objects, looks for schema.org microdata and JSOβ¦β150Updated 2 years ago
- β111Updated 11 months ago
- A simple puppeteer wrapper to enable useful plugins with easeβ55Updated this week
- Distributed crawling infrastructure running on top of severless computation, cloud storage (such as S3) and sophisticated queues.β423Updated 2 years ago
- π Tooling to access Puppeteer's internal Isolated World.β21Updated 4 years ago
- Add-ons for Playwright: adblocker, stealth modeβ46Updated 4 years ago
- How to detect puppeteer with 100% accuracyβ108Updated 3 years ago
- β25Updated 3 years ago
- A suite of tools for protecting the web's open knowledge.β127Updated 5 months ago
- π‘ Renew the IP address of a tethered Android device via Node asynchronously.β74Updated last year
- Fingerprinting script of Fingerprint-Scannerβ245Updated this week
- β13Updated last year
- Proxies Puppeteer Page requests.β208Updated 6 months ago
- β33Updated this week
- Google Search SERP Scraperβ107Updated last year
- JavaScript code of many commercial bot detectors/fingerprinting services and string deobfuscators for them if applicable.β124Updated 3 years ago
- Index Common Crawl archives in tabular formatβ112Updated 3 months ago
- Extract text from HTMLβ134Updated 4 years ago
- A single tab web browser built with puppeteer. Also, no client-side JS. Viewport is streamed with MJPEG. For realz.β56Updated last year
- π΅ββ Bot detection tests for Puppeteer. Hide and seek!β88Updated last year