flesler / node-spiderLinks
Generic web crawler powered by NodeJS
☆65Updated 7 years ago
Alternatives and similar repositories for node-spider
Users that are interested in node-spider are comparing it to the libraries listed below
Sorting:
- Download images from remote URLs or use local images and encode/decode them to Base64 string or Buffer object☆141Updated 3 weeks ago
- Simple captcha for Node.JS and Express.☆136Updated 7 years ago
- 📂 Lightweight filesize to human-readable / proportions w/o dependencies for node.js & browsers.☆232Updated 5 years ago
- A module for creating, reading, updating, and deleting system cron jobs☆188Updated 2 years ago
- A download tool with support for http/https proxy.☆64Updated 3 years ago
- remote file copy wrapper for node.js☆77Updated 5 years ago
- expressjs view helper methods☆81Updated 6 years ago
- ☆113Updated 7 years ago
- a more powerful thunkify☆53Updated 3 years ago
- URL rewriting middleware for express☆48Updated last year
- blanket basic auth middleware☆138Updated 6 years ago
- A benchmark tool.☆34Updated 3 years ago
- NodeJS SQL query builder☆124Updated 6 months ago
- iHuyi 106 SMS sender for node.js.☆11Updated 4 years ago
- koa version of Connect-Roles☆118Updated 6 years ago
- Returns the real IP address of users in Node.js☆124Updated last year
- Detect image dimensions via request.☆38Updated 2 years ago
- A web requester for node.js.☆25Updated 11 months ago
- 🎨 GD graphics library (libgd) C++ bindings for Node.js.☆105Updated 2 weeks ago
- a promise-based ftp client for node.js☆81Updated 3 years ago
- convert img to base64, or convert base64 to img☆164Updated 6 years ago
- Crawler is a web spider written with Nodejs. It gives you the full power of jQuery on the server to parse a big number of pages as they a…☆41Updated 8 years ago
- Middleware allowing the client to filter the response to only what they need, reducing the amount of traffic over the wire.☆94Updated 7 years ago
- Flatten a multi-dimensional array in JavaScript.☆87Updated 3 months ago
- A powerful watermark library for single page images, multipage images, and pdf files based on ImageMagick for node.js☆104Updated 5 years ago
- run chrome with nodejs in code☆16Updated 7 years ago
- Simple RESTful url router.☆86Updated 4 months ago
- general server render base on headless chrome☆93Updated 7 years ago
- Scrape/Crawl article from any site automatically. Make any web page readable, no matter Chinese or English.☆345Updated 7 years ago
- Captcha generation for NodeJS☆185Updated 6 years ago