christian-fei / mega-scraper
the mega scraper - scrape a website's content
☆27Updated 4 years ago
Alternatives and similar repositories for mega-scraper
Users that are interested in mega-scraper are comparing it to the libraries listed below
Sorting:
- A collection of awesome PouchDB libraries, plugins, resources and shiny things.☆28Updated 5 years ago
- A `htmlparser2` handler for parsing rich metadata from HTML. Includes HTML metadata, JSON-LD, RDFa, microdata, OEmbed, Twitter cards and …☆55Updated last year
- A plugin for puppeteer-extra to add proxy support☆18Updated 2 years ago
- Robust text renderer using headless chrome.☆66Updated last year
- Naive Bayes Text Classifier☆40Updated 2 months ago
- Scrape subreddits based on search criteria or get the X latest from 'hot' or 'new' categories☆27Updated 4 years ago
- Chromium / Puppeteer site crawler☆49Updated 5 years ago
- Extracts prices from an arbitrary text input.☆16Updated 6 years ago
- Chop a single stream of data into a series of readable streams☆29Updated 6 years ago
- An Implementation of Jaro Distance Algorithm by Matthew A. Jaro☆13Updated 3 years ago
- 📦 Clean up messy package metadata from the npm registry☆37Updated 5 years ago
- Easily create zip archives☆13Updated 5 years ago
- Magic utility that extract javascript global variables from a remote html page.☆12Updated 2 years ago
- A sparse array optimised for low memory whilst still being fast☆32Updated 2 years ago
- [WIP] Web Crawler in Node.js to spider dynamically whole websites.☆35Updated 5 years ago
- Simple request driver for x-ray☆14Updated 8 years ago
- 🌲 A transport for reformatting pino logs into standard syslog format☆31Updated 3 months ago
- Lightweight and efficient iterators☆50Updated 5 years ago
- Event sourcing JavaScript entity class☆11Updated 8 years ago
- npm i -g crunsh-single-page☆10Updated 8 years ago
- Transforms nested values of complex objects☆44Updated 6 years ago
- HTTP header string parser☆40Updated 3 years ago
- CLI Simple, Stupid. Automatic discovery of parameters names. Provides an easy and minimal setup by passing in only a function reference w…☆10Updated 3 years ago
- Detect resize on an element without polling or iframes☆23Updated last year
- All the npm registry metadata as an offline event stream. [DEPRECATED]☆24Updated 8 years ago
- Duplex stream that allows you to send messages, including binary messages☆17Updated 4 years ago
- Creates screencasting-like gifs of page-scrolls☆16Updated 2 years ago
- a puppeteer walker 🕷 🕸☆79Updated 4 years ago
- x-ray's selector parser.☆16Updated 9 years ago
- List of words for making random mnemonic sentences☆87Updated last year