NikolaiT / struktur
Module that extracts structured information from a rendered html site and outputs JSON. HTML to JSON.
☆70Updated 3 years ago
Alternatives and similar repositories for struktur
Users that are interested in struktur are comparing it to the libraries listed below
Sorting:
- 🧱 A uniform template to use as a foundation for Puppeteer bot construction.☆66Updated 4 years ago
- Apify actor that opens a web page in headless Chrome and analyzes the HTML and JavaScript objects, looks for schema.org microdata and JSO…☆150Updated 2 years ago
- A test suite of common scraper detection techniques. See how detectable your scraper stack is.☆136Updated 2 years ago
- NodeJs package for generating browser-like headers.☆71Updated 2 years ago
- Cloud crawler functions for scrapeulous☆45Updated 4 years ago
- DFPM is a browser extension for detecting browser fingerprinting.☆118Updated 2 years ago
- Minimal set of tools to conduct stealthy scraping.☆156Updated 2 years ago
- 🛡🎭 A conceptual patch which modifies some vanilla puppeteer files to decrease detection rates.☆54Updated 4 years ago
- A Node.js library to easily manage and rotate a pool of web browsers, using any of the popular browser automation libraries like Puppetee…☆94Updated 2 years ago
- Automatically extracts structured information from webpages☆109Updated 2 years ago
- Distributed crawling infrastructure running on top of severless computation, cloud storage (such as S3) and sophisticated queues.☆430Updated 2 years ago
- Bypassing bot detection checks with Puppeteer.☆93Updated 4 years ago
- Add-ons for Playwright: adblocker, stealth mode☆46Updated 4 years ago
- Scrapy rotation proxy package with advanced functions☆95Updated 2 years ago
- A web page that compiles methods used by Akamai, Datadome, and other bot detection solutions and WAF (Web Application Firewall) to identi…☆42Updated 4 years ago
- 🔐 Tooling to access Puppeteer's internal Isolated World.☆22Updated 4 years ago
- ☆115Updated last year
- 🕵♂ Bot detection tests for Puppeteer. Hide and seek!☆93Updated 2 years ago
- Fingerprinting script of Fingerprint-Scanner☆246Updated 2 months ago
- A suite of tools for protecting the web's open knowledge.☆127Updated 8 months ago
- A simple puppeteer wrapper to enable useful plugins with ease☆56Updated this week
- Parse And Create Web ARChive (WARC) files with node.js☆98Updated 3 months ago
- Home of fingerprint injector.☆69Updated 2 years ago
- Nodejs lib to parse Google SERP html pages☆47Updated last year
- Generates realistic browser fingerprints☆78Updated 2 years ago
- admin ui for scrapy/open source scrapinghub☆58Updated 4 years ago
- Proxies Puppeteer Page requests.☆208Updated 8 months ago
- Scraping assistant tool. Editing and maintaining CSS/XPath selectors across webpages.☆103Updated 6 years ago
- How to detect puppeteer with 100% accuracy☆109Updated 3 years ago
- CoCrawler is a versatile web crawler built using modern tools and concurrency.☆190Updated 3 years ago