flesler / node-spiderLinks
Generic web crawler powered by NodeJS
☆65Updated 7 years ago
Alternatives and similar repositories for node-spider
Users that are interested in node-spider are comparing it to the libraries listed below
Sorting:
- Simple captcha for Node.JS and Express.☆136Updated 7 years ago
- Download images from remote URLs or use local images and encode/decode them to Base64 string or Buffer object☆142Updated last month
- A module for creating, reading, updating, and deleting system cron jobs☆189Updated 2 years ago
- A download tool with support for http/https proxy.☆64Updated 3 years ago
- Crawler is a web spider written with Nodejs. It gives you the full power of jQuery on the server to parse a big number of pages as they a…☆41Updated 8 years ago
- Promisified nedb wrapper☆96Updated 6 years ago
- Makes it easy to manipulate id-based resources with lodash or lowdb☆475Updated 3 years ago
- a promise-based ftp client for node.js☆81Updated 3 years ago
- Middleware allowing the client to filter the response to only what they need, reducing the amount of traffic over the wire.☆94Updated 7 years ago
- general server render base on headless chrome☆93Updated 7 years ago
- Generate an object for testing if a request is sent, request is Mikeal's request.☆44Updated 5 years ago
- simple non-compliant xml parser for nodejs☆102Updated 2 years ago
- Returns the real IP address of users in Node.js☆124Updated last year
- Convert videos to gifs using ffmpeg and gifsicle☆300Updated 3 years ago
- TCP ping utility for node.js☆125Updated last year
- remote file copy wrapper for node.js☆76Updated 5 years ago
- convert img to base64, or convert base64 to img☆164Updated 6 years ago
- blanket basic auth middleware☆138Updated 6 years ago
- A benchmark tool.☆34Updated 3 years ago
- NodeJS SQL query builder☆124Updated 7 months ago
- Detect image dimensions via request.☆38Updated 2 years ago
- FTP, FTPS and SFTP client for node.js, mainly a lftp wrapper.☆204Updated 2 years ago
- Duplex stream that runs over Electron's IPC☆155Updated 9 years ago
- NaiveBayes classifier for JavaScript☆143Updated 2 years ago
- Scrape/Crawl article from any site automatically. Make any web page readable, no matter Chinese or English.☆346Updated 7 years ago
- koa version of Connect-Roles☆118Updated 6 years ago
- ☆113Updated 8 years ago
- Parse nginx logs☆64Updated 8 years ago
- Promise-based Alert, Confirm and Prompt replacement☆88Updated last year
- Well-known SMTP server configuations☆154Updated 3 years ago