website-scraper / node-website-scraperLinks
Download website to local directory (including all css, images, js, etc.)
☆1,667Updated 2 weeks ago
Alternatives and similar repositories for node-website-scraper
Users that are interested in node-website-scraper are comparing it to the libraries listed below
Sorting:
- Plugin for website-scraper which returns html for dynamic websites using puppeteer☆361Updated 2 weeks ago
- A complete and versatile web scraper.☆3,720Updated 5 years ago
- 🔮 A Node.js scraper for humans.☆4,070Updated 3 months ago
- Flexible event driven crawler for node.☆2,135Updated 4 years ago
- A web crawler. Supercrawler automatically crawls websites. Define custom handlers to parse content. Obeys robots.txt, rate limits and con…☆382Updated 3 years ago
- A JavaScript library for generating random user agents with data that's updated daily.☆1,141Updated last month
- Plugin for website-scraper which returns html for dynamic websites using PhantomJS.☆58Updated 4 years ago
- Puppeteer Pool, run a cluster of instances in parallel☆3,506Updated last month
- A curated list of awesome puppeteer resources.☆2,539Updated last year
- The headless Chrome/Chromium driver on top of Puppeteer. Take screenshots, generate PDFs, extract text and HTML with a production-ready A…☆1,771Updated last week
- Additional module to use with 'puppeteer' for setting proxies per page basis.☆451Updated last year
- Node.js implementation of a proxy server (think Squid) with support for SSL, HTTP/HTTPS, SOCKS5, authentication, and upstream proxy chain…☆974Updated 3 weeks ago
- Automatically extract body content (and other cool stuff) from an html document☆2,163Updated 2 years ago
- Puppeteer example scripts for running Headless Chrome from Node.☆3,054Updated 5 years ago
- Puppeteer (Headless Chrome Node API)-based rendering solution.☆548Updated 3 years ago
- Get a random user agent (with an optional filter to select from a specific set of user agents).☆259Updated 3 years ago
- Capture screenshots of websites☆2,009Updated 3 months ago
- youtube-dl driver for node☆1,692Updated 4 years ago
- Get unified metadata from websites using Open Graph, Microdata, RDFa, Twitter Cards, JSON-LD, HTML, and more.☆2,613Updated last week
- Use puppeteer to test and control your electron application.☆357Updated 2 years ago
- Advanced html to text converter☆1,686Updated 2 years ago
- Download and extract files☆1,305Updated 2 years ago
- A chrome extension to record your actions into a nightmare or puppeteer script☆2,765Updated last year
- Demo app for website-scraper module☆83Updated last year
- Simple API-caching middleware for Express/Node.☆1,247Updated 3 years ago
- The next web scraper. See through the <html> noise.☆5,908Updated 2 weeks ago
- Javascript scraping module based on puppeteer for many different search engines...☆566Updated 3 years ago
- Simple node.js utility to create video slideshows from images with optional audio and visual effects using ffmpeg☆900Updated 2 weeks ago
- Web scraper for NodeJS☆4,114Updated 2 years ago
- libcurl bindings for Node.js☆711Updated 2 weeks ago