christian-fei / mega-scraperLinks
the mega scraper - scrape a website's content
☆28Updated 5 years ago
Alternatives and similar repositories for mega-scraper
Users that are interested in mega-scraper are comparing it to the libraries listed below
Sorting:
- Robust text renderer using headless chrome.☆66Updated 2 years ago
- A plugin for puppeteer-extra to add proxy support☆18Updated 3 years ago
- A `htmlparser2` handler for parsing rich metadata from HTML. Includes HTML metadata, JSON-LD, RDFa, microdata, OEmbed, Twitter cards and …☆56Updated 2 years ago
- Nodejs web scraper. Contains a command line, docker container, terraform module and ansible roles for distributed cloud scraping. Support…☆113Updated 2 years ago
- Simple proxy rotation service☆30Updated 10 years ago
- Module that extracts structured information from a rendered html site and outputs JSON. HTML to JSON.☆70Updated 4 years ago
- Scrape subreddits based on search criteria or get the X latest from 'hot' or 'new' categories☆27Updated 4 years ago
- Technologies I've learned☆66Updated 2 months ago
- Easily generate correct user-agent strings for popular browsers☆74Updated 4 years ago
- Helpers for Bash like shell scripting in JavaScript☆20Updated 2 years ago
- Refresh, monitor and balance your proxies☆16Updated 7 months ago
- Create a stream of Sequelize create, update, and destroy events.☆11Updated 5 years ago
- a puppeteer walker 🕷 🕸☆79Updated 5 years ago
- An experimental distributed JWT token cracker built using Node.js and ZeroMQ☆57Updated last year
- Convert a URL to a valid filename☆80Updated 4 months ago
- Make your functions resilient and fail-fast to failures or delays☆12Updated last year
- A proxy that sits in between a chromium devtools frontend and the remote chromium being debugged and logs requests, responses and websock…☆21Updated 5 years ago
- An undetectable browser automation framework 🤖☆35Updated 4 years ago
- Extracts all JSON objects from an arbitrary text document.☆30Updated 5 years ago
- A lightweight flow control module that works like a mini event bus + serial/parallel processor.☆20Updated 4 years ago
- Extracts prices from an arbitrary text input.☆16Updated 7 years ago
- Pipe something from command line to a chart in the browser☆39Updated 2 years ago
- Naive Bayes Classifier in JavaScript☆32Updated 8 years ago
- HTML template editor for quickly working with handlebars and liquid templates.☆16Updated 3 years ago
- Flexible nodejs HMAC authentication module for express/connect and beyond☆36Updated 5 years ago
- Small module wrapper for the AWS sdk that allows you to easily use s3 or the local file system☆79Updated 6 years ago
- 🏴 A straightforward forward-proxy written in Node.js.☆83Updated last year
- Storage backend for Passwordless using Redis☆15Updated 7 years ago
- ⛏ A versatile Web scraper for Node.js☆46Updated last month
- Auto installs npm dependencies from the script you want to run and runs the script☆47Updated last year