bda-research / node-webcrawlerLinks
Crawler is a web spider written with Nodejs. It gives you the full power of jQuery on the server to parse a big number of pages as they are downloaded, asynchronously
☆41Updated 8 years ago
Alternatives and similar repositories for node-webcrawler
Users that are interested in node-webcrawler are comparing it to the libraries listed below
Sorting:
- Node.js Client Library for seaweedfs (weed-fs)☆50Updated 3 years ago
- Friendly web crawler for x-ray☆44Updated 2 years ago
- Image optimizer, PNG, JPEG and GIFimage compress on OS X, Linux, FreeBSD and Windows☆67Updated 5 years ago
- Generate an unique ID depending on time, machine and process for use in a distributed environment.☆240Updated 4 years ago
- general server render base on headless chrome☆93Updated 7 years ago
- Interactive terminal list for nodejs☆125Updated 11 years ago
- Native javascript implementation of the standard Sphinx API☆76Updated 6 years ago
- A node.js (>= 0.8.x) compatible multi-process management module☆277Updated 11 years ago
- remote monitoring and debugging for socket.io☆451Updated 10 years ago
- ❤️ Middleware for easy rendering of async Query results.☆316Updated 9 years ago
- Watches for changes in MongoDB replication log.☆95Updated 10 years ago
- Smart and easy request rate limiter for your APIs built on `koa`, using `koa-ip-filter`. Support custom stores, custom ID, custom error …☆38Updated 2 years ago
- Adds a handy `trace` flag to the console object to prepend the file and line number.☆298Updated 13 years ago
- Simple SMTP server/client module☆395Updated 10 years ago
- Middleware to attach your express app's request & response to a domain. No more process.uncaughtException nonsense.☆120Updated 10 years ago
- NodeJS library for rate limiting using sliding windows stored in Redis☆78Updated 9 years ago
- Promise-based wrapper for node-orm2☆61Updated 8 years ago
- phash for images☆55Updated 5 years ago
- ☆101Updated last year
- ☆18Updated 8 years ago
- PhantomJS resource pool based on generic-pool☆106Updated 6 years ago
- Run node with ES6 Generators, today!☆248Updated 9 years ago
- A Koa.js middleware for performing internal batch requests☆36Updated 6 years ago
- Axon RPC client / server☆105Updated 11 years ago
- MongoDB-backed job queue for Node.js☆182Updated 8 years ago
- Streaming Imagemagick API☆92Updated 4 years ago
- A 2nd generation spider to crawl any article site, automatic read title and article.☆43Updated 9 years ago
- process usage lookup with nodejs☆387Updated 5 years ago
- Promises/A+ conformant implementation☆84Updated 8 years ago
- Sticky session balancer with layer 4 capabilities, based on a `cluster` module☆72Updated 4 years ago