flesler / node-spiderLinks
Generic web crawler powered by NodeJS
☆66Updated 6 years ago
Alternatives and similar repositories for node-spider
Users that are interested in node-spider are comparing it to the libraries listed below
Sorting:
- Simple captcha for Node.JS and Express.☆136Updated 7 years ago
- A module for creating, reading, updating, and deleting system cron jobs☆189Updated 2 years ago
- URL rewriting middleware for express☆48Updated 8 months ago
- Smart and easy request rate limiter for your APIs built on `koa`, using `koa-ip-filter`. Support custom stores, custom ID, custom error …☆38Updated 2 years ago
- Cron for JavaScript. Still in development.☆122Updated 7 years ago
- A log4js-node log appender to write logs into MongoDB☆39Updated 4 years ago
- expressjs view helper methods☆81Updated 6 years ago
- Connect middleware for busboy☆155Updated last year
- Crontab-based task scheduler for node.☆26Updated 8 years ago
- How similar are these two strings?☆77Updated 4 years ago
- A download tool with support for http/https proxy.☆64Updated 3 years ago
- A benchmark tool.☆33Updated 3 years ago
- a more powerful thunkify☆53Updated 3 years ago
- Adds a handy `trace` flag to the console object to prepend the file and line number.☆297Updated 12 years ago
- DEPRECATED – Simple, synchronous deflate/inflate for node.js buffers☆63Updated 9 years ago
- Well-known SMTP server configuations☆154Updated 3 years ago
- remote file copy wrapper for node.js☆78Updated 5 years ago
- ☆20Updated 8 years ago
- Allow to upload the content of a folder to a remote server through SFT utilizing pure Javascript.☆40Updated 2 weeks ago
- Probability.js makes it easy to call JavaScript functions by probability in Node.js and the browser.☆166Updated 2 years ago
- A 2nd generation spider to crawl any article site, automatic read title and article.☆43Updated 9 years ago
- blanket basic auth middleware☆138Updated 6 years ago
- Download images from remote URLs or use local images and encode/decode them to Base64 string or Buffer object☆141Updated last month
- run chrome with nodejs in code☆16Updated 7 years ago
- An optionally-asynchronous forEach with an interesting interface.☆76Updated 4 years ago
- Plugin to get and set alias for fields in Mongoose schemas to reduce db memory footprint☆56Updated 8 years ago
- scriptable command-line shell written with node.js☆110Updated 10 years ago
- Server middleware to power socket.io-p2p. Handles signalling☆55Updated 2 years ago
- Node.js Client Library for seaweedfs (weed-fs)☆50Updated 2 years ago
- Automatically minify and cache your javascript and css files.☆86Updated 7 years ago