bda-research / node-webcrawlerLinks
Crawler is a web spider written with Nodejs. It gives you the full power of jQuery on the server to parse a big number of pages as they are downloaded, asynchronously
☆41Updated 9 years ago
Alternatives and similar repositories for node-webcrawler
Users that are interested in node-webcrawler are comparing it to the libraries listed below
Sorting:
- Node.js Client Library for seaweedfs (weed-fs)☆50Updated 3 years ago
- Image optimizer, PNG, JPEG and GIFimage compress on OS X, Linux, FreeBSD and Windows☆67Updated 5 years ago
- Friendly web crawler for x-ray☆44Updated 3 years ago
- general server render base on headless chrome☆93Updated 8 years ago
- PhantomJS resource pool based on generic-pool☆106Updated 6 years ago
- Dashboards for the Node.js monitor project☆203Updated 5 years ago
- remote monitoring and debugging for socket.io☆451Updated 11 years ago
- Native javascript implementation of the standard Sphinx API☆76Updated 6 years ago
- Watches for changes in MongoDB replication log.☆95Updated 10 years ago
- Sticky session balancer with layer 4 capabilities, based on a `cluster` module☆72Updated 4 years ago
- Interactive terminal list for nodejs☆125Updated 12 years ago
- Generate an unique ID depending on time, machine and process for use in a distributed environment.☆240Updated 5 years ago
- HTML5/Node/WebSocket MongoDB panel☆437Updated 10 years ago
- A node.js (>= 0.8.x) compatible multi-process management module☆277Updated 11 years ago
- A better array for the browser and node.js. Supports events & many functional goodies.☆708Updated 2 years ago
- On the fly, thumbnail creation middleware for express.☆85Updated 4 years ago
- Headless is a Node.js wrapper for Xvfb, the virtual framebuffer☆95Updated 9 years ago
- Advanced streaming http request proxy middleware for Express with support for custom routes, caching, and response transforms.☆95Updated 3 years ago
- Streaming Imagemagick API☆92Updated 4 years ago
- Express middleware for performing internal batch requests☆86Updated 5 years ago
- Middleware allowing the client to filter the response to only what they need, reducing the amount of traffic over the wire.☆94Updated 7 years ago
- etagify is connect middleware to add ETag headers to cachable but non-static content.☆49Updated 13 years ago
- A node module for transaction-like db writes☆31Updated 8 years ago
- A 2nd generation spider to crawl any article site, automatic read title and article.☆43Updated 10 years ago
- ☆113Updated 8 years ago
- A web scraper with a web user interface which shows scraping stats in realtime. Uses Node.JS, jQuery, socket.io and Express.☆105Updated 11 years ago
- Adds `markdown` property to Nodemailer e-mail data☆37Updated 6 years ago
- Promise-based wrapper for node-orm2☆61Updated 8 years ago
- A no-dependencies HTTP client library for browsers and Node.js with a promise-based or Node.js-style callback-based API to progress event…☆342Updated 10 years ago
- Elegant UDP messaging for nodejs☆345Updated 7 years ago