website-scraper / node-website-scraperLinks
Download website to local directory (including all css, images, js, etc.)
☆1,653Updated 3 weeks ago
Alternatives and similar repositories for node-website-scraper
Users that are interested in node-website-scraper are comparing it to the libraries listed below
Sorting:
- Plugin for website-scraper which returns html for dynamic websites using puppeteer☆350Updated last week
- Flexible event driven crawler for node.☆2,137Updated 4 years ago
- A complete and versatile web scraper.☆3,718Updated 4 years ago
- Web Crawler/Spider for NodeJS + server-side jQuery ;-)☆6,785Updated 4 months ago
- Advanced html to text converter☆1,675Updated last year
- A curated list of awesome puppeteer resources.☆2,522Updated last year
- Web scraping library made by the Phantombuster team. Modern, simple & works on all websites. (Deprecated)☆500Updated 5 years ago
- Web crawler for Node.JS☆255Updated 7 years ago
- Puppeteer (Headless Chrome Node API)-based rendering solution.☆545Updated 3 years ago
- Automatically extract body content (and other cool stuff) from an html document☆2,158Updated 2 years ago
- Puppeteer example scripts for running Headless Chrome from Node.☆3,051Updated 5 years ago
- The headless Chrome/Chromium driver on top of Puppeteer.☆1,746Updated 3 weeks ago
- Download and extract files☆1,301Updated last year
- Capture screenshots of websites☆1,987Updated 3 weeks ago
- Declarative DOM extraction expression evaluator. 👨⚕️☆692Updated 5 years ago
- A JavaScript library for generating random user agents with data that's updated daily.☆1,104Updated this week
- send mail without setting up a SMTP server☆569Updated last year
- Node.js implementation of a proxy server (think Squid) with support for SSL, authentication and upstream proxy chaining.☆944Updated this week
- A web crawler. Supercrawler automatically crawls websites. Define custom handlers to parse content. Obeys robots.txt, rate limits and con…☆380Updated 2 years ago
- Get image size without full download. Supported image types: JPG, GIF, PNG, WebP, BMP, TIFF, SVG, PSD, ICO.☆1,001Updated 2 years ago
- Native NodeJS implementation of MaxMind's GeoIP API -- works in node 0.6.3 and above, ask me about other versions☆2,380Updated last year
- A chrome extension to record your actions into a nightmare or puppeteer script☆2,766Updated 10 months ago
- 📚 Turn any web page into a clean view☆2,518Updated 4 years ago
- Get unified metadata from websites using Open Graph, Microdata, RDFa, Twitter Cards, JSON-LD, HTML, and more.☆2,566Updated last week
- Scaffold out a Chrome extension☆2,638Updated 3 years ago
- Robust RSS, Atom, and RDF feed parsing in Node.js☆1,976Updated last year
- Additional module to use with 'puppeteer' for setting proxies per page basis.☆451Updated last year
- Web scraper for NodeJS☆4,116Updated last year
- Small tool to wait that all xhr are finished in puppeteer☆278Updated last month
- Scrape/Crawl article from any site automatically. Make any web page readable, no matter Chinese or English.☆345Updated 7 years ago