amoilanen / js-crawler
Web crawler for Node.JS
☆253Updated 6 years ago
Alternatives and similar repositories for js-crawler:
Users that are interested in js-crawler are comparing it to the libraries listed below
- A web crawler. Supercrawler automatically crawls websites. Define custom handlers to parse content. Obeys robots.txt, rate limits and con…☆379Updated 2 years ago
- Node module that summarizes text using a naive summarization algorithm☆770Updated 3 months ago
- Flexible event driven crawler for node.☆2,141Updated 3 years ago
- A Node.js module to search and scrape Google.☆454Updated 6 years ago
- The core monitoring functionality of forever without the CLI☆1,159Updated 6 months ago
- A Node.JS module, which provides an object oriented wrapper for the YouTube v3 API.☆356Updated 4 years ago
- Drive CasperJS from Node.js☆908Updated 8 years ago
- Modeled from the (Facebook Javascript SDK), now with the facebook-node-sdk you can now easily write the same code and share between your …☆739Updated 7 years ago
- Machine-learning for Node.js☆1,054Updated 6 months ago
- A complete and versatile web scraper.☆3,714Updated 4 years ago
- A UI to view Agenda jobs☆266Updated 7 years ago
- Web scraping and HTML-reprocessing. The easy way.☆393Updated 6 years ago
- Web scraping library made by the Phantombuster team. Modern, simple & works on all websites. (Deprecated)☆501Updated 4 years ago
- Scrape/Crawl article from any site automatically. Make any web page readable, no matter Chinese or English.☆343Updated 6 years ago
- ImageMagick's Magick++ bindings for NodeJS☆627Updated 4 years ago
- A natural language classifier using Node Natural with a BrainJS neural network☆319Updated 5 years ago
- Generic web crawler powered by NodeJS☆67Updated 6 years ago
- A node server and module which allows for cross-domain page scraping on web documents with JSONP or POST.☆746Updated 8 months ago
- Youtube api implementation for nodeJS☆109Updated last year
- Brute-force protection middleware for express routes by rate limiting incoming requests☆567Updated 3 years ago
- Instagram api client for node that support promises.☆190Updated 2 years ago
- Rate limiting middleware for Express☆424Updated 5 years ago
- A simple natural language tool written for NodeJS☆388Updated 6 years ago
- MongoDB 2.4 text search support for mongoose☆154Updated 11 years ago
- Node module for delivering optimized, minified, mangled, gzipped assets with Express and Amazon's CDN (S3/CloudFront)☆661Updated 5 years ago
- Highly scalable Node.js scraping framework for mobsters☆298Updated 2 years ago
- Agenda Dashboard☆796Updated 4 months ago
- phantom driver for x-ray.☆111Updated 8 years ago
- Function containerizer for Node.js. (The engine behind actions2, helpers, and shell scripts in Sails.)☆144Updated last year
- Node.js module to create and trigger your own webHooks.☆190Updated last year