tilakpatidar / bot-marvin
Highly scalable crawler with best features.
☆11Updated 8 years ago
Alternatives and similar repositories for bot-marvin:
Users that are interested in bot-marvin are comparing it to the libraries listed below
- Extract meta-data from a html string. It extracts the body, title, meta-tags and first headlines to a object to push them to a search ind…☆13Updated 8 years ago
- A simple standalone reverse proxy that automatically enables server-push for assets related to a HTTP response.☆24Updated 8 years ago
- Friendly web crawler for x-ray☆44Updated 2 years ago
- Make your functions resilient and fail-fast to failures or delays☆13Updated last year
- Social media profile aggregator for node.js☆23Updated 10 years ago
- The chrome extension of rrweb which helps to run rrweb on any website out of box☆18Updated 2 years ago
- A simple component to check the status of a domain (whois, availability, expired, PR, TrustFlow, ...)☆33Updated 8 years ago
- x-ray's selector parser.☆16Updated 9 years ago
- A lightweight fast static file server for node loaded with useful features☆56Updated 2 years ago
- Stargazerz - export repository 🌟 stargazers 🌟 profile as JSON☆10Updated 8 years ago
- Convenience functions for the Puppeteer☆25Updated 2 years ago
- A Benchmarking Suite for popular Image Optimisation Tools☆28Updated 3 years ago
- Higher level client for Elasticsearch written in Node.js oriented on facets and simplicity☆20Updated last month
- ☆33Updated 11 years ago
- A 2nd generation spider to crawl any article site, automatic read title and article.☆43Updated 9 years ago
- Predictive text in JavaScript☆29Updated 12 years ago
- A command-line tool for generating HTTP Archive (HAR) (based on Electron)☆47Updated 6 years ago
- transform streaming html using css selectors☆48Updated last year
- CLI for rendering text with headless chrome.☆11Updated 4 years ago
- CLI for scrape-it. A Node.js scraper for humans.☆16Updated last month
- Live query. Mirror part of a DB on the client.☆12Updated 8 years ago
- ☆15Updated 12 years ago
- Takes an array of numbers and calculates some descriptive statistics☆16Updated 4 years ago
- NodeJS Named Entity Recognition, using Stanford NER (easy install)☆40Updated 7 years ago
- Wikipedia PageRank Project☆41Updated 11 years ago
- A `htmlparser2` handler for parsing rich metadata from HTML. Includes HTML metadata, JSON-LD, RDFa, microdata, OEmbed, Twitter cards and …☆53Updated last year
- PageRank calculation for ngraph.graph☆28Updated 3 weeks ago
- Instrument a JavaScript class (or object) so that anytime a method function is called it gets logged to the console.☆35Updated 4 years ago
- Create a stream of Sequelize create, update, and destroy events.☆11Updated 4 years ago
- Extract a list of keywords from a website, sorted by word count.☆51Updated 8 years ago