bda-research / node-webcrawlerLinks
Crawler is a web spider written with Nodejs. It gives you the full power of jQuery on the server to parse a big number of pages as they are downloaded, asynchronously
☆41Updated 8 years ago
Alternatives and similar repositories for node-webcrawler
Users that are interested in node-webcrawler are comparing it to the libraries listed below
Sorting:
- Node.js Client Library for seaweedfs (weed-fs)☆50Updated 2 years ago
- High-availability redis in Node.js.☆154Updated 7 years ago
- Middleware allowing the client to filter the response to only what they need, reducing the amount of traffic over the wire.☆94Updated 7 years ago
- Watches for changes in MongoDB replication log.☆95Updated 10 years ago
- An easy way to include all files within a directory. Note: This is a fork of felixge's require-all which allows for optional includes.☆55Updated 2 years ago
- Middleware to attach your express app's request & response to a domain. No more process.uncaughtException nonsense.☆120Updated 9 years ago
- Promise-based wrapper for node-orm2☆61Updated 8 years ago
- Nodejs Client for Cayley☆57Updated 8 years ago
- Plugin to get and set alias for fields in Mongoose schemas to reduce db memory footprint☆56Updated 8 years ago
- Promises/A+ conformant implementation☆85Updated 8 years ago
- ☆18Updated 7 years ago
- REST interface for Redis-Simple-Message-Queue☆43Updated 8 years ago
- Smart and easy request rate limiter for your APIs built on `koa`, using `koa-ip-filter`. Support custom stores, custom ID, custom error …☆38Updated 2 years ago
- vhost for koajs☆20Updated 10 years ago
- A node.js (>= 0.8.x) compatible multi-process management module☆278Updated 11 years ago
- A tiny middleware of RESTful API for koa.☆44Updated 7 years ago
- Run node with ES6 Generators, today!☆247Updated 9 years ago
- Application supervisor that automatically adds cluster control and performance monitoring with StrongOps☆66Updated 2 years ago
- Cache your Mongoose MongoDB query results with Redis. 300% faster queries FTW!☆237Updated 11 years ago
- Help developers build their own nw.js apps for different platforms such as win, mac and linux with gulp.☆25Updated 8 years ago
- Axon RPC client / server☆105Updated 11 years ago
- Strongloop Loopback connector for Elasticsearch☆33Updated 10 years ago
- New RegExp Style for Node.js☆59Updated 11 years ago
- Friendly web crawler for x-ray☆44Updated 2 years ago
- etagify is connect middleware to add ETag headers to cachable but non-static content.☆49Updated 13 years ago
- Image optimizer, PNG, JPEG and GIFimage compress on OS X, Linux, FreeBSD and Windows☆67Updated 5 years ago
- Native javascript implementation of the standard Sphinx API☆76Updated 6 years ago
- A Knex.js backend for node_acl☆46Updated 2 years ago
- Simple captcha for Node.JS and Express.☆136Updated 7 years ago
- A gulp node-inspector wrapper☆21Updated 8 years ago