christian-fei / mega-scraperLinks
the mega scraper - scrape a website's content
☆28Updated 5 years ago
Alternatives and similar repositories for mega-scraper
Users that are interested in mega-scraper are comparing it to the libraries listed below
Sorting:
- Robust text renderer using headless chrome.☆66Updated 2 years ago
- A plugin for puppeteer-extra to add proxy support☆18Updated 2 years ago
- a puppeteer walker 🕷 🕸☆79Updated 5 years ago
- Language agnostic named entity recognizer☆40Updated 2 years ago
- A `htmlparser2` handler for parsing rich metadata from HTML. Includes HTML metadata, JSON-LD, RDFa, microdata, OEmbed, Twitter cards and …☆56Updated 2 years ago
- CLI for rendering text with headless chrome.☆11Updated 5 years ago
- Extracts prices from an arbitrary text input.☆16Updated 6 years ago
- Simple proxy rotation service☆30Updated 10 years ago
- Refresh, monitor and balance your proxies☆16Updated 5 months ago
- Efficient (de)compression package for AWS Lambda☆26Updated 8 months ago
- Convert a URL to a valid filename☆80Updated 2 months ago
- RPC calls via postMessage☆17Updated last year
- Instagram get images 🌄 (hashtags, account, locations) with puppeteer☆79Updated 2 weeks ago
- Naive Bayes Text Classifier☆42Updated 9 months ago
- Technologies I've learned☆66Updated last month
- Gather meta information from chrome web store.☆16Updated 4 years ago
- 🌃 Start and control a Tor instance.☆12Updated 3 years ago
- Scrape subreddits based on search criteria or get the X latest from 'hot' or 'new' categories☆28Updated 4 years ago
- Friendly web crawler for x-ray☆44Updated 2 years ago
- Accurate and fast sentiment scoring of phrases with #hashtags, emoticons :) & emojis 🎉☆63Updated 2 years ago
- ⛏ A versatile Web scraper for Node.js☆46Updated this week
- Create HTML snippets/embeds from URLs using info from oEmbed, Open Graph, meta tags.☆66Updated 2 years ago
- Decorator to memoize the results of async functions via lru-cache.☆23Updated 5 years ago
- Alpine - the Apache Log Parser for Node.js☆16Updated 4 years ago
- Convenience functions for the Puppeteer☆25Updated 2 years ago
- Collection of useful utilities for working with Google Cloud Storage.☆13Updated 2 years ago
- Storage backend for Passwordless using Redis☆15Updated 7 years ago
- Given any image (GIF, PNG, WebP, AVIF, etc) extract predominant & palette colors.☆120Updated 2 weeks ago
- Automagically generates summaries from html or text.☆69Updated 2 years ago
- Extracts all JSON objects from an arbitrary text document.☆30Updated 5 years ago