amoilanen / js-crawlerLinks
Web crawler for Node.JS
☆255Updated 7 years ago
Alternatives and similar repositories for js-crawler
Users that are interested in js-crawler are comparing it to the libraries listed below
Sorting:
- A Node.js module to search and scrape Google.☆456Updated 7 years ago
- Simple, lightweight and expressive web scraping with Node.js☆153Updated 3 years ago
- A web crawler. Supercrawler automatically crawls websites. Define custom handlers to parse content. Obeys robots.txt, rate limits and con…☆380Updated 2 years ago
- Scrape/Crawl article from any site automatically. Make any web page readable, no matter Chinese or English.☆345Updated 7 years ago
- [No longer maintained] eBay API Client for Node.js☆155Updated 6 years ago
- Examples and supplementary documentation for Nightmare☆250Updated 8 years ago
- phantom driver for x-ray.☆111Updated 9 years ago
- A node server and module which allows for cross-domain page scraping on web documents with JSONP or POST.☆746Updated last year
- Node module that summarizes text using a naive summarization algorithm☆770Updated 11 months ago
- Instagram api client for node that support promises.☆190Updated 2 years ago
- Flexible event driven crawler for node.☆2,137Updated 4 years ago
- A Node.JS module, which provides an object oriented wrapper for the YouTube v3 API.☆361Updated 7 months ago
- Download images from remote URLs or use local images and encode/decode them to Base64 string or Buffer object☆141Updated 3 weeks ago
- Node.js email SMTP verification, powered by EmailChecker.com API☆292Updated 2 years ago
- Modeled from the (Facebook Javascript SDK), now with the facebook-node-sdk you can now easily write the same code and share between your …☆739Updated 8 years ago
- Node module for delivering optimized, minified, mangled, gzipped assets with Express and Amazon's CDN (S3/CloudFront)☆658Updated 5 years ago
- bridge to PhantomJS from Node.js☆317Updated 6 years ago
- A search server that can be installed with npm☆656Updated last month
- Drive CasperJS from Node.js☆906Updated 9 years ago
- Stop denial of service attacks, configurable allowable burst rate.☆235Updated 2 years ago
- A complete and versatile web scraper.☆3,718Updated 4 years ago
- NPM package for creating a keyword array from a string and excluding stop words.☆200Updated last year
- Generate an object for testing if a request is sent, request is Mikeal's request.☆44Updated 4 years ago
- WordNet Database files (previously WNdb)☆218Updated 5 years ago
- Google Calendar API connection in Node.js☆233Updated 7 years ago
- Generic web crawler powered by NodeJS☆65Updated 7 years ago
- NodeJS Implementation of Decision Tree using ID3 Algorithm☆214Updated 2 weeks ago
- Amazon Product Advertising API client☆366Updated 7 years ago
- A web scraper with a web user interface which shows scraping stats in realtime. Uses Node.JS, jQuery, socket.io and Express.☆106Updated 10 years ago
- Simplifies node HTTP request making.☆224Updated 6 years ago