bda-research / node-webcrawler
Crawler is a web spider written with Nodejs. It gives you the full power of jQuery on the server to parse a big number of pages as they are downloaded, asynchronously
☆41Updated 7 years ago
Related projects ⓘ
Alternatives and complementary repositories for node-webcrawler
- Node.js Client Library for seaweedfs (weed-fs)☆50Updated 2 years ago
- Friendly web crawler for x-ray☆44Updated last year
- Image optimizer, PNG, JPEG and GIFimage compress on OS X, Linux, FreeBSD and Windows☆67Updated 4 years ago
- general server render base on headless chrome☆95Updated 7 years ago
- A tiny middleware of RESTful API for koa.☆43Updated 7 years ago
- Native javascript implementation of the standard Sphinx API☆76Updated 5 years ago
- A node.js module to implement a recommender engine with popular machine-learning algorithms.☆61Updated 9 years ago
- Smart and easy request rate limiter for your APIs built on `koa`, using `koa-ip-filter`. Support custom stores, custom ID, custom error …☆38Updated last year
- Redis adapter for SocketCluster☆45Updated 4 years ago
- Adds a handy `trace` flag to the console object to prepend the file and line number.☆296Updated 12 years ago
- A full-featured httpp/http proxy to work with Nodejs-Httpp☆43Updated last year
- A Knex.js backend for node_acl☆46Updated last year
- Sticky session balancer with layer 4 capabilities, based on a `cluster` module☆72Updated 3 years ago
- Redis-based task queue library inspired by Celery and Kue.☆56Updated 10 years ago
- Image analysis and comparison☆66Updated 8 years ago
- Axon RPC client / server☆104Updated 10 years ago
- Empower your koa.js application with realtime☆26Updated 4 years ago
- Middleware to attach your express app's request & response to a domain. No more process.uncaughtException nonsense.☆120Updated 9 years ago
- A Koa.js middleware for performing internal batch requests☆36Updated 5 years ago
- Wrap all koa calls in a transaction☆14Updated 9 years ago
- Adds `markdown` property to Nodemailer e-mail data☆37Updated 5 years ago
- Parse nginx logs☆64Updated 7 years ago
- x-ray's selector parser.☆16Updated 8 years ago
- Promises/A+ conformant implementation☆86Updated 7 years ago
- A gulp node-inspector wrapper☆21Updated 7 years ago
- Middleware allowing the client to filter the response to only what they need, reducing the amount of traffic over the wire.☆93Updated 6 years ago
- AMQP RPC driver for node. Tested on RabbitMQ.☆49Updated 8 years ago
- Application supervisor that automatically adds cluster control and performance monitoring with StrongOps☆66Updated 2 years ago
- A pm2 application container for docker.☆75Updated 6 years ago