NikolaiT / strukturLinks
Module that extracts structured information from a rendered html site and outputs JSON. HTML to JSON.
β70Updated 4 years ago
Alternatives and similar repositories for struktur
Users that are interested in struktur are comparing it to the libraries listed below
Sorting:
- Distributed crawling infrastructure running on top of severless computation, cloud storage (such as S3) and sophisticated queues.β436Updated 3 years ago
- π§± A uniform template to use as a foundation for Puppeteer bot construction.β67Updated 4 years ago
- A test suite of common scraper detection techniques. See how detectable your scraper stack is.β141Updated 3 years ago
- Minimal set of tools to conduct stealthy scraping.β162Updated 2 years ago
- A Node.js library to easily manage and rotate a pool of web browsers, using any of the popular browser automation libraries like Puppeteeβ¦β98Updated 3 years ago
- Apify actor that opens a web page in headless Chrome and analyzes the HTML and JavaScript objects, looks for schema.org microdata and JSOβ¦β153Updated 2 years ago
- π‘π A conceptual patch which modifies some vanilla puppeteer files to decrease detection rates.β55Updated 4 years ago
- NodeJs package for generating browser-like headers.β72Updated 3 years ago
- Cloud crawler functions for scrapeulousβ45Updated 4 years ago
- π Tooling to access Puppeteer's internal Isolated World.β21Updated 4 years ago
- DFPM is a browser extension for detecting browser fingerprinting.β125Updated 3 years ago
- A simple puppeteer wrapper to enable useful plugins with easeβ57Updated last week
- Javascript scraping module based on puppeteer for many different search engines...β566Updated 3 years ago
- Email automation driven by headless chrome.β167Updated 5 years ago
- β116Updated last year
- A web crawler. Supercrawler automatically crawls websites. Define custom handlers to parse content. Obeys robots.txt, rate limits and conβ¦β382Updated 3 years ago
- Fingerprinting script of Fingerprint-Scannerβ257Updated 10 months ago
- House of Apify Scrapers. Generic scraping actors with a simple UI to handle complex web crawling and scraping use cases.β127Updated this week
- Is headless chrome currently detectable? Let's pit the detections and detection evasions against eachother.β661Updated 4 years ago
- Proxies Puppeteer Page requests.β215Updated last year
- Scraping assistant tool. Editing and maintaining CSS/XPath selectors across webpages.β125Updated 7 years ago
- π΅ββ Bot detection tests for Puppeteer. Hide and seek!β104Updated 2 years ago
- Generates realistic browser fingerprintsβ86Updated 3 years ago
- Bypassing bot detection checks with Puppeteer.β93Updated 5 years ago
- Add-ons for Playwright: adblocker, stealth modeβ45Updated 4 years ago
- The web scraper that's nearly impossible to block - now called @ulixee/heroβ726Updated 2 years ago
- Nodejs lib to parse Google SERP html pagesβ47Updated 2 years ago
- Base Docker images for Apify actors.β90Updated this week
- Expose the Chrome extension API to puppeteerβ14Updated 4 years ago
- π΄ A straightforward forward-proxy written in Node.js.β83Updated last year