christian-fei / mega-scraper
the mega scraper - scrape a website's content
☆27Updated 4 years ago
Related projects ⓘ
Alternatives and complementary repositories for mega-scraper
- Robust text renderer using headless chrome.☆65Updated 11 months ago
- Chop a single stream of data into a series of readable streams☆29Updated 6 years ago
- A plugin for puppeteer-extra to add proxy support☆17Updated last year
- Extracts prices from an arbitrary text input.☆17Updated 5 years ago
- A `htmlparser2` handler for parsing rich metadata from HTML. Includes HTML metadata, JSON-LD, RDFa, microdata, OEmbed, Twitter cards and …☆50Updated 11 months ago
- HTML template editor for quickly working with handlebars and liquid templates.☆16Updated last year
- an ftp client that expose the node fs API☆38Updated 5 years ago
- 🌃 Start and control a Tor instance.☆12Updated 2 years ago
- ☆80Updated 4 years ago
- Stream that transcodes video and audio codecs☆39Updated 5 years ago
- A zero-boilerplate solution for using ES7 async functions in Express and other middleware-based web frameworks.☆24Updated 6 years ago
- Hash a value to a valid port☆34Updated 3 years ago
- Derive a named key from a high-entropy master key☆25Updated 4 years ago
- Validate Domain Names as outlined by RFC 2181☆14Updated 8 years ago
- A sparse array optimised for low memory whilst still being fast☆32Updated last year
- HTTP header string parser☆41Updated 2 years ago
- Extracts time from an arbitrary text input.☆19Updated 4 years ago
- Make your functions resilient and fail-fast to failures or delays☆13Updated 8 months ago
- Small module to mirror a folder to another folder. Supports live mode as well.☆87Updated 4 years ago
- Decent decentralized application framework☆35Updated 4 years ago
- Get CPU usage percentage of own process☆19Updated 4 years ago
- Scrape subreddits based on search criteria or get the X latest from 'hot' or 'new' categories☆26Updated 3 years ago
- ☆16Updated 6 years ago
- Returns a `stream.Readable` from a URI string☆50Updated last year
- Naive Bayes Text Classifier☆39Updated 4 months ago
- Flexible nodejs HMAC authentication module for express/connect and beyond☆36Updated 4 years ago
- MongoDB query language implemented as a node.js Stream☆49Updated 5 years ago
- Small module that helps you maintain state around resources☆54Updated 4 years ago
- Simple proxy rotation service☆30Updated 9 years ago
- Get a JSON array of a Twitter user's latest tweets -- no Twitter API required!☆16Updated last year