bda-research / node-webcrawlerLinks
Crawler is a web spider written with Nodejs. It gives you the full power of jQuery on the server to parse a big number of pages as they are downloaded, asynchronously
☆41Updated 8 years ago
Alternatives and similar repositories for node-webcrawler
Users that are interested in node-webcrawler are comparing it to the libraries listed below
Sorting:
- Node.js Client Library for seaweedfs (weed-fs)☆50Updated 3 years ago
- Friendly web crawler for x-ray☆44Updated 2 years ago
- remote monitoring and debugging for socket.io☆451Updated 10 years ago
- Image optimizer, PNG, JPEG and GIFimage compress on OS X, Linux, FreeBSD and Windows☆67Updated 5 years ago
- Middleware allowing the client to filter the response to only what they need, reducing the amount of traffic over the wire.☆94Updated 7 years ago
- Adds a handy `trace` flag to the console object to prepend the file and line number.☆298Updated 13 years ago
- general server render base on headless chrome☆93Updated 7 years ago
- High-availability redis in Node.js.☆154Updated 7 years ago
- A better array for the browser and node.js. Supports events & many functional goodies.☆710Updated 2 years ago
- Interactive terminal list for nodejs☆125Updated 11 years ago
- Watches for changes in MongoDB replication log.☆95Updated 10 years ago
- Middleware to attach your express app's request & response to a domain. No more process.uncaughtException nonsense.☆120Updated 10 years ago
- Take a screenshot of your desktop.☆48Updated 7 years ago
- bridge to PhantomJS from Node.js☆316Updated 6 years ago
- Simple SMTP server/client module☆395Updated 10 years ago
- redisq - fast message processing queue backed up by redis and nodejs☆64Updated 3 years ago
- HTML5/Node/WebSocket MongoDB panel☆439Updated 9 years ago
- Redis adapter for SocketCluster☆45Updated 5 years ago
- restify middleware that validates a JsonWebToken (JWT) and sets the req.user with the attributes☆82Updated 4 years ago
- Promise-based wrapper for node-orm2☆61Updated 8 years ago
- ❤️ Middleware for easy rendering of async Query results.☆316Updated 9 years ago
- Lightweight Redis adapter for Node.js/Sails apps, focused on providing easy direct access to the configured, connected, ready-to-use Redi…☆129Updated 6 years ago
- Simple bridge to phantomjs for Node☆201Updated 5 years ago
- sandcrawler.js - the server-side scraping companion.☆108Updated 9 years ago
- ☆101Updated last year
- A tiny middleware of RESTful API for koa.☆43Updated 8 years ago
- Adds `markdown` property to Nodemailer e-mail data☆37Updated 6 years ago
- A node module for transaction-like db writes☆31Updated 8 years ago
- Create thumbnails from images, video, audio and web pages.☆123Updated 9 years ago
- PhantomJS resource pool based on generic-pool☆106Updated 6 years ago