tilakpatidar / bot-marvinLinks
Highly scalable crawler with best features.
☆11Updated 8 years ago
Alternatives and similar repositories for bot-marvin
Users that are interested in bot-marvin are comparing it to the libraries listed below
Sorting:
- Extract meta-data from a html string. It extracts the body, title, meta-tags and first headlines to a object to push them to a search ind…☆13Updated 8 years ago
- Make your functions resilient and fail-fast to failures or delays☆13Updated last year
- x-ray's selector parser.☆16Updated 9 years ago
- Extract a list of keywords from a website, sorted by word count.☆51Updated 8 years ago
- Takes an array of numbers and calculates some descriptive statistics☆16Updated 4 years ago
- Friendly web crawler for x-ray☆44Updated 2 years ago
- Creates screencasting-like gifs of page-scrolls☆16Updated 2 years ago
- Live query. Mirror part of a DB on the client.☆12Updated 8 years ago
- Social media profile aggregator for node.js☆23Updated 10 years ago
- A 2nd generation spider to crawl any article site, automatic read title and article.☆43Updated 9 years ago
- Scrapes a remote page and creates a summary with statistics☆39Updated 10 years ago
- ☆33Updated 11 years ago
- Convenience functions for the Puppeteer☆25Updated 2 years ago
- Tools for electron apps to work with licenses.☆19Updated 5 years ago
- List of familiar American-English words: The Revised Spache (1974)☆15Updated 2 years ago
- A simple standalone reverse proxy that automatically enables server-push for assets related to a HTTP response.☆24Updated 8 years ago
- Stargazerz - export repository 🌟 stargazers 🌟 profile as JSON☆10Updated 8 years ago
- Retrieve real (with Javascript executed) HTML code from an URL, ultra fast and supports multiple parallel loading of webs☆22Updated 7 years ago
- Detect if the Chrome Inspector is open or closed.☆326Updated 11 years ago
- Analyze HTTP access logs and visualize statistics w/ focus on mobile usage☆26Updated 11 years ago
- A lightweight fast static file server for node loaded with useful features☆56Updated 2 years ago
- Flexible nodejs HMAC authentication module for express/connect and beyond☆36Updated 5 years ago
- Naive Bayes Text Classifier☆40Updated 4 months ago
- transform streaming html using css selectors☆48Updated last year
- A small node application to use to automate repetitive interactions on certain social networks☆13Updated 4 years ago
- Extract links from Google SERP☆48Updated 8 years ago
- a puppeteer walker 🕷 🕸☆79Updated 4 years ago
- [WIP] Web Crawler in Node.js to spider dynamically whole websites.☆35Updated 5 years ago
- A `htmlparser2` handler for parsing rich metadata from HTML. Includes HTML metadata, JSON-LD, RDFa, microdata, OEmbed, Twitter cards and …☆55Updated last year
- Robust text renderer using headless chrome.☆66Updated last year