Alternatives and similar repositories for mega-scraper

Users that are interested in mega-scraper are comparing it to the libraries listed below

• transitive-bullshit / puppeteer-render-text
  Robust text renderer using headless chrome.
  ☆66Updated last year
• f9mac / puppeteer-extra-plugin-proxy
  A plugin for puppeteer-extra to add proxy support
  ☆18Updated 2 years ago
• NikolaiT / struktur
  Module that extracts structured information from a rendered html site and outputs JSON. HTML to JSON.
  ☆70Updated 4 years ago
• joewhite86 / proxy-rotator
  Simple proxy rotation service
  ☆30Updated 9 years ago
• get-set-fetch / scraper
  Nodejs web scraper. Contains a command line, docker container, terraform module and ansible roles for distributed cloud scraping. Support…
  ☆114Updated 2 years ago
• lrlna / puppeteer-walker
  a puppeteer walker 🕷 🕸
  ☆79Updated 4 years ago
• hfreire / perseverance
  Make your functions resilient and fail-fast to failures or delays
  ☆13Updated last year
• Vladislao / proxy-supervisor
  Refresh, monitor and balance your proxies
  ☆16Updated 2 months ago
• mafintosh / s3-storage
  Small module wrapper for the AWS sdk that allows you to easily use s3 or the local file system
  ☆79Updated 5 years ago
• winkjs / wink-sentiment
  Accurate and fast sentiment scoring of phrases with #hashtags, emoticons :) & emojis 🎉
  ☆62Updated 2 years ago
• bencevans / nightlink
  🌃 Start and control a Tor instance.
  ☆13Updated 3 years ago
• pitops / reddit-bot-scraper
  Scrape subreddits based on search criteria or get the X latest from 'hot' or 'new' categories
  ☆26Updated 4 years ago
• saasify-sh / template-editor
  HTML template editor for quickly working with handlebars and liquid templates.
  ☆16Updated 2 years ago
• gajus / crack-json
  Extracts all JSON objects from an arbitrary text document.
  ☆30Updated 5 years ago
• gajus / extract-price
  Extracts prices from an arbitrary text input.
  ☆16Updated 6 years ago
• blakeembrey / node-htmlmetaparser
  A `htmlparser2` handler for parsing rich metadata from HTML. Includes HTML metadata, JSON-LD, RDFa, microdata, OEmbed, Twitter cards and …
  ☆55Updated last year
• alixaxel / lambdafs
  Efficient (de)compression package for AWS Lambda
  ☆26Updated 4 months ago
• vtempest / bypasscors
  Bypass CORS (Cross-Origin Resource Sharing) get HTML from external domains and make your own API
  ☆14Updated 7 years ago
• gajus / extract-email-address
  Extracts email address from an arbitrary text input.
  ☆64Updated 6 months ago
• wix-incubator / pm-rpc
  RPC calls via postMessage
  ☆17Updated last year
• Agenty / browser-automation-api
  Browser automation API for repetitive web-based tasks, with a friendly user interface. You can use it to scrape content or do many other …
  ☆31Updated 3 years ago
• hackergrrl / latest-tweets
  Get a JSON array of a Twitter user's latest tweets -- no Twitter API required!
  ☆16Updated 2 years ago
• winkjs / wink-ner
  Language agnostic named entity recognizer
  ☆39Updated 2 years ago
• jmar777 / node-async-router
  A zero-boilerplate solution for using ES7 async functions in Express and other middleware-based web frameworks.
  ☆24Updated 7 years ago
• feross / run-waterfall
  Run an array of functions in series, each passing its results to the next function
  ☆91Updated 4 years ago
• watson / stream-chopper
  Chop a single stream of data into a series of readable streams
  ☆29Updated 6 years ago
• max-mapper / ftpfs
  an ftp client that expose the node fs API
  ☆37Updated 5 years ago
• mafintosh / vizbug
  A context aware debug logger
  ☆42Updated 5 years ago
• thlorenz / chromium-remote-debugging-proxy
  A proxy that sits in between a chromium devtools frontend and the remote chromium being debugged and logs requests, responses and websock…
  ☆20Updated 4 years ago
• mawrkus / jason-the-miner
  ⛏ A versatile Web scraper for Node.js
  ☆45Updated 3 weeks ago