christian-fei / mega-scraper
the mega scraper - scrape a website's content
☆27Updated 4 years ago
Alternatives and similar repositories for mega-scraper:
Users that are interested in mega-scraper are comparing it to the libraries listed below
- Extracts prices from an arbitrary text input.☆16Updated 6 years ago
- A proxy that sits in between a chromium devtools frontend and the remote chromium being debugged and logs requests, responses and websock…☆20Updated 4 years ago
- Robust text renderer using headless chrome.☆65Updated last year
- Bypass CORS (Cross-Origin Resource Sharing) get HTML from external domains and make your own API☆14Updated 7 years ago
- Scrape subreddits based on search criteria or get the X latest from 'hot' or 'new' categories☆26Updated 3 years ago
- A `htmlparser2` handler for parsing rich metadata from HTML. Includes HTML metadata, JSON-LD, RDFa, microdata, OEmbed, Twitter cards and …☆52Updated last year
- Get a JSON array of a Twitter user's latest tweets -- no Twitter API required!☆16Updated 2 years ago
- Extracts time from an arbitrary text input.☆18Updated 4 years ago
- Make your functions resilient and fail-fast to failures or delays☆13Updated 10 months ago
- 🌲 A transport for reformatting pino logs into standard syslog format☆31Updated 7 months ago
- given two streams of newline delimited JSON data perform a merge/extend on each object in the stream☆49Updated 8 years ago
- x-ray's selector parser.☆16Updated 8 years ago
- Files in Markdown.☆17Updated 3 months ago
- Instrument a JavaScript class (or object) so that anytime a method function is called it gets logged to the console.☆35Updated 4 years ago
- A sparse array optimised for low memory whilst still being fast☆32Updated 2 years ago
- Ever dreamed of rendering Markdown in the console? No. Neither had I.☆26Updated 6 years ago
- Chop a single stream of data into a series of readable streams☆29Updated 6 years ago
- A collection of awesome PouchDB libraries, plugins, resources and shiny things.☆28Updated 5 years ago
- Hash a value to a valid port☆34Updated 4 years ago
- CLI for Instagram automation driven by headless chrome.☆14Updated 4 years ago
- Decorator to memoize the results of async functions via lru-cache.☆23Updated 4 years ago
- CLI Simple, Stupid. Automatic discovery of parameters names. Provides an easy and minimal setup by passing in only a function reference w…☆10Updated 3 years ago
- Keep track of things in the future.☆12Updated 7 years ago
- 🌃 Start and control a Tor instance.☆13Updated 2 years ago
- Dynamic script loading for modern browsers☆47Updated 3 years ago
- A zero-boilerplate solution for using ES7 async functions in Express and other middleware-based web frameworks.☆24Updated 6 years ago
- Get all urls from a HTML markup☆12Updated this week
- an ftp client that expose the node fs API☆38Updated 5 years ago
- Warn about incorrect English usage with retext☆11Updated 7 years ago