flesler / node-spider
Generic web crawler powered by NodeJS
☆67Updated 6 years ago
Alternatives and similar repositories for node-spider:
Users that are interested in node-spider are comparing it to the libraries listed below
- Simple captcha for Node.JS and Express.☆136Updated 6 years ago
- A download tool with support for http/https proxy.☆64Updated 2 years ago
- simple non-compliant xml parser for nodejs☆102Updated last year
- fetch & parse ATOM & RSS feeds with Node.js☆74Updated 6 years ago
- Generate an object for testing if a request is sent, request is Mikeal's request.☆44Updated 4 years ago
- Adds `markdown` property to Nodemailer e-mail data☆37Updated 5 years ago
- Cache mongoose queries in memory, redis or use your own driver☆80Updated 5 years ago
- Next-generation take on pre/post function hooks☆82Updated 9 months ago
- Headless is a Node.js wrapper for Xvfb, the virtual framebuffer☆93Updated 8 years ago
- ☆28Updated 7 years ago
- ☆102Updated 7 months ago
- A benchmark tool.☆33Updated 2 years ago
- An optionally-asynchronous forEach with an interesting interface.☆76Updated 4 years ago
- Node library to extract keywords from text☆58Updated 9 years ago
- A module for creating, reading, updating, and deleting system cron jobs☆188Updated last year
- Download images from remote URLs or use local images and encode/decode them to Base64 string or Buffer object☆133Updated last month
- URL rewriting middleware for express☆48Updated 3 months ago
- Probability.js makes it easy to call JavaScript functions by probability in Node.js and the browser.☆165Updated last year
- A very fast streaming multipart parser for node.js☆186Updated last year
- Extract meta-data from a html string. It extracts the body, title, meta-tags and first headlines to a object to push them to a search ind…☆14Updated 8 years ago
- Persistent socket connections with pool for node server side.☆8Updated 6 years ago
- Hash and compare passwords with pbkdf2☆132Updated 8 years ago
- Crawler is a web spider written with Nodejs. It gives you the full power of jQuery on the server to parse a big number of pages as they a…☆41Updated 8 years ago
- Friendly web crawler for x-ray☆44Updated 2 years ago
- Middleware allowing the client to filter the response to only what they need, reducing the amount of traffic over the wire.☆94Updated 6 years ago
- Crontab-based task scheduler for node.☆26Updated 8 years ago
- Humanize a number 1000000.99 -> 1,000,000.99☆25Updated 11 years ago
- a smart and tiny README maker using default manifest package.json☆89Updated 9 years ago
- a more powerful thunkify☆54Updated 2 years ago
- ☆217Updated 4 years ago