tilakpatidar / bot-marvin
Highly scalable crawler with best features.
☆11Updated 8 years ago
Alternatives and similar repositories for bot-marvin:
Users that are interested in bot-marvin are comparing it to the libraries listed below
- Extract meta-data from a html string. It extracts the body, title, meta-tags and first headlines to a object to push them to a search ind…☆13Updated 8 years ago
- CLI for rendering text with headless chrome.☆11Updated 4 years ago
- Social media profile aggregator for node.js☆23Updated 10 years ago
- A simple component to check the status of a domain (whois, availability, expired, PR, TrustFlow, ...)☆33Updated 8 years ago
- Higher level client for Elasticsearch written in Node.js oriented on facets and simplicity☆20Updated 2 months ago
- x-ray's selector parser.☆16Updated 9 years ago
- Robust text renderer using headless chrome.☆66Updated last year
- Friendly web crawler for x-ray☆44Updated 2 years ago
- A face recognition in JavaScript using my neural network☆16Updated 6 years ago
- A `htmlparser2` handler for parsing rich metadata from HTML. Includes HTML metadata, JSON-LD, RDFa, microdata, OEmbed, Twitter cards and …☆54Updated last year
- Calculate remaining reading time estimates in real-time☆24Updated 10 years ago
- Extract a list of keywords from a website, sorted by word count.☆51Updated 8 years ago
- A Benchmarking Suite for popular Image Optimisation Tools☆28Updated 3 years ago
- A 2nd generation spider to crawl any article site, automatic read title and article.☆43Updated 9 years ago
- A simple standalone reverse proxy that automatically enables server-push for assets related to a HTTP response.☆24Updated 8 years ago
- Serializes any DOM node into a String☆37Updated 5 years ago
- Instrument a JavaScript class (or object) so that anytime a method function is called it gets logged to the console.☆35Updated 4 years ago
- client for wayback machine data☆15Updated 7 years ago
- A lightweight fast static file server for node loaded with useful features☆56Updated 2 years ago
- Retrieve real (with Javascript executed) HTML code from an URL, ultra fast and supports multiple parallel loading of webs☆22Updated 7 years ago
- Make your functions resilient and fail-fast to failures or delays☆13Updated last year
- ☆33Updated 11 years ago
- PageRank calculation for ngraph.graph☆28Updated last month
- ☆12Updated 3 years ago
- A simple DOM wrapper for libxmljs☆13Updated 2 years ago
- An image similarity search engine and database.☆78Updated 2 years ago
- Extract links from Google SERP☆48Updated 8 years ago
- Predictive text in JavaScript☆29Updated 12 years ago
- Create a stream of Sequelize create, update, and destroy events.☆11Updated 4 years ago
- A JS Library that compares two DOM Nodes and outputs what changed between the two.☆154Updated 8 years ago