website-scraper / node-website-scraperLinks
Download website to local directory (including all css, images, js, etc.)
☆1,664Updated 3 weeks ago
Alternatives and similar repositories for node-website-scraper
Users that are interested in node-website-scraper are comparing it to the libraries listed below
Sorting:
- Plugin for website-scraper which returns html for dynamic websites using puppeteer☆358Updated last month
- A complete and versatile web scraper.☆3,720Updated 5 years ago
- Flexible event driven crawler for node.☆2,134Updated 4 years ago
- Puppeteer (Headless Chrome Node API)-based rendering solution.☆547Updated 3 years ago
- A JavaScript library for generating random user agents with data that's updated daily.☆1,138Updated 2 weeks ago
- Scrape Instagram's API with Puppeteer☆407Updated 3 years ago
- The next web scraper. See through the <html> noise.☆5,904Updated last month
- Plugin for website-scraper which returns html for dynamic websites using PhantomJS.☆58Updated 4 years ago
- Web scraping library made by the Phantombuster team. Modern, simple & works on all websites. (Deprecated)☆498Updated 5 years ago
- Get unified metadata from websites using Open Graph, Microdata, RDFa, Twitter Cards, JSON-LD, HTML, and more.☆2,604Updated 2 weeks ago
- A curated list of awesome puppeteer resources.☆2,533Updated last year
- Capture screenshots of websites☆1,999Updated 2 months ago
- Additional module to use with 'puppeteer' for setting proxies per page basis.☆451Updated last year
- Get a random user agent (with an optional filter to select from a specific set of user agents).☆259Updated 2 years ago
- The headless Chrome/Chromium driver on top of Puppeteer.☆1,768Updated 2 weeks ago
- A web crawler. Supercrawler automatically crawls websites. Define custom handlers to parse content. Obeys robots.txt, rate limits and con…☆382Updated 3 years ago
- Google Search SERP Scraper☆125Updated this week
- Node.js implementation of a proxy server (think Squid) with support for SSL, authentication and upstream proxy chaining.☆966Updated this week
- Small tool to wait that all xhr are finished in puppeteer☆277Updated 2 months ago
- --DEPRECATED -- 🛑 🛑 Node.js library to bypass cloudflare's anti-ddos page☆603Updated 5 years ago
- Sitemap-generating framework for node.js☆1,701Updated last week
- Javascript scraping module based on puppeteer for many different search engines...☆567Updated 3 years ago
- A chrome extension to record your actions into a nightmare or puppeteer script☆2,764Updated last year
- youtube-dl driver for node☆1,692Updated 4 years ago
- Command line youtube video downloader.☆1,280Updated 2 months ago
- Web scraper for NodeJS☆4,114Updated 2 years ago
- A simple "database" that use JSON file for Node.JS.☆829Updated this week
- Nimble, streamable HTTP client for Node.js. With proxy, iconv, cookie, deflate & multipart support.☆1,635Updated last month
- Simple API-caching middleware for Express/Node.☆1,246Updated 2 years ago
- Instagram automation driven by headless chrome.☆119Updated 3 years ago