N0taN3rd / node-warcLinks
Parse And Create Web ARChive (WARC) files with node.js
☆102Updated 9 months ago
Alternatives and similar repositories for node-warc
Users that are interested in node-warc are comparing it to the libraries listed below
Sorting:
- Squidwarc is a high fidelity, user scriptable, archival crawler that uses Chrome or Chromium with or without a head☆171Updated 5 years ago
- wabac.js - Web Archive Browsing Augmentation Client☆114Updated last week
- JS Streaming WARC IO optimized for Browser and Node☆51Updated 2 months ago
- Browsertrix: Containerized High-Fidelity Browser-Based Automated Crawling + Behavior System☆87Updated 4 years ago
- Automatically extracts structured information from webpages☆109Updated 3 years ago
- 🤬 Map of profane words to a rating of sureness☆260Updated 2 years ago
- Storex Core - A modular and portable database abstraction ecosystem for JavaScript☆155Updated 8 months ago
- roll a wikipedia dump into mongo☆248Updated last year
- Fast Metaphone implementation☆53Updated 3 years ago
- generate rules from lists of words☆16Updated 4 years ago
- React components to render differences between captures at the Wayback Machine☆35Updated this week
- Module that extracts structured information from a rendered html site and outputs JSON. HTML to JSON.☆70Updated 4 years ago
- ⚙️ [Processor] A better English POS tagger written in JavaScript☆56Updated 8 years ago
- Natural Language Concrete Syntax Tree format☆226Updated last year
- Throw JavaScript objects at the index and they will become retrievable by their properties using promises and map-reduce☆19Updated 3 months ago
- HTML5 Canvas implementation for NodeJS backed by Puppeteer☆65Updated 2 years ago
- Fast approximate string matching library for JavaScript☆53Updated last year
- Specifications developed and maintained by the Webrecorder community.☆136Updated last month
- Accurate and fast sentiment scoring of phrases with #hashtags, emoticons :) & emojis 🎉☆62Updated 2 years ago
- Fast Full Text Search based on BM25☆67Updated 3 years ago
- A list of tools related to W(eb)ARC(hive)☆64Updated 11 years ago
- 🔖 Node.js module for manipulating extended attributes☆67Updated 4 years ago
- Simularity identification in JS☆37Updated last year
- Multilingual tokenizer that automatically tags each token with its type☆64Updated 2 years ago
- Snapshots a web page to get it as a static, self-contained HTML document.☆297Updated 3 years ago
- Get n-grams from text☆83Updated 3 years ago
- A `htmlparser2` handler for parsing rich metadata from HTML. Includes HTML metadata, JSON-LD, RDFa, microdata, OEmbed, Twitter cards and …☆57Updated last year
- Local reverse geocoder for Node.js based on GeoNames data☆207Updated last year
- A JavaScript framework for the MediaWiki API.☆33Updated 4 years ago
- Formula to detect ease of reading according to the Automated Readability Index (1967)☆52Updated 3 years ago