Tjatse / spider2
A 2nd generation spider to crawl any article site, automatic read title and article.
☆43Updated 9 years ago
Alternatives and similar repositories for spider2:
Users that are interested in spider2 are comparing it to the libraries listed below
- Crawler is a web spider written with Nodejs. It gives you the full power of jQuery on the server to parse a big number of pages as they a…☆41Updated 8 years ago
- Friendly web crawler for x-ray☆44Updated 2 years ago
- Demos for the limdu.js package☆18Updated 2 years ago
- x-ray's selector parser.☆16Updated 9 years ago
- High-availability redis in Node.js.☆154Updated 6 years ago
- Redis-based task queue library inspired by Celery and Kue.☆56Updated 11 years ago
- NLP utilities in javascript and coffeescript☆37Updated 11 years ago
- Scrape/Crawl article from any site automatically. Make any web page readable, no matter Chinese or English.☆344Updated 6 years ago
- Take screenshots☆40Updated 2 years ago
- Extract the content of any web page by using various content extractor libraries.☆10Updated 9 years ago
- Nodejs wrapper for Stanford Classifier.☆47Updated 4 years ago
- node.js wrapper for the Diffbot API (article and frontpage)☆35Updated 9 years ago
- Watches for changes in MongoDB replication log.☆95Updated 10 years ago
- sandcrawler.js - the server-side scraping companion.☆107Updated 9 years ago
- Extract meta-data from a html string. It extracts the body, title, meta-tags and first headlines to a object to push them to a search ind…☆13Updated 8 years ago
- Hosted viewer for documentation.js JSON output.☆34Updated 8 years ago
- Simhash implementation in Javascript☆38Updated 7 years ago
- A web crawler/scraper/spider for nodejs☆66Updated 7 years ago
- A node.js module to implement a recommender engine with popular machine-learning algorithms.☆61Updated 9 years ago
- A node.js wrapper for Boilerpipe, an excellent Java library for boilerplate removal and fulltext extraction from HTML pages.☆52Updated 7 years ago
- A simple node.js wrapper for Stanford CoreNLP.☆77Updated 3 years ago
- A realtime clone of the Hacker News homepage backed by HN's Firebase API☆51Updated 10 years ago
- boot single-instance application☆21Updated 7 years ago
- NodeJS Named Entity Recognition, using Stanford NER (easy install)☆40Updated 7 years ago
- Upload large(r) videos to youtube via Google's 'resumable upload' API☆43Updated 6 years ago
- Strongloop Loopback connector for Elasticsearch☆33Updated 10 years ago
- phantom driver for x-ray.☆111Updated 8 years ago
- Node.js client for PredictionIO☆17Updated 9 years ago
- Redis Message Connector☆14Updated 6 years ago
- A boilerplate for building a superscript bot☆37Updated 8 years ago