Crawler is a web spider written with Nodejs. It gives you the full power of jQuery on the server to parse a big number of pages as they are downloaded, asynchronously
☆41Dec 12, 2016Updated 9 years ago
Alternatives and similar repositories for node-webcrawler
Users that are interested in node-webcrawler are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Evented Node.js module for downloading songs from SoundCloud.☆19Jan 14, 2016Updated 10 years ago
- Crawl the DHT network for resource infohashes☆10Dec 17, 2016Updated 9 years ago
- Upload video quickly to Streamable.com☆11Jan 23, 2017Updated 9 years ago
- TTY, you so fly.☆43Aug 28, 2013Updated 12 years ago
- Hacker News readers as Progressive Web Apps with React, react-router, redux, Immutable.js☆13Jul 2, 2018Updated 7 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A Node.js module for resizing, and uploading files to Amazon S3 with capability to track progress using websockets.☆43Nov 8, 2016Updated 9 years ago
- A JavaScript library to help create single file custom builds for front-end projects.☆75Dec 19, 2013Updated 12 years ago
- Configurable Denial-Of-Service prevention library☆11Jan 20, 2018Updated 8 years ago
- Advanced web-based frontend for Aria2-JSONRPC☆34Nov 13, 2017Updated 8 years ago
- ☆16Jun 27, 2019Updated 6 years ago
- System for mining Wikipedia Usage data to read our collective mind☆20Sep 28, 2014Updated 11 years ago
- get and compare perceptual hashes (as computed by imagemagick)☆18Dec 30, 2022Updated 3 years ago
- InputDevice API proposal☆17Mar 8, 2021Updated 5 years ago
- ☆18Aug 26, 2019Updated 6 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- An openload.co API handler☆20Apr 28, 2018Updated 8 years ago
- Get the dimensions of a video☆22Jan 26, 2016Updated 10 years ago
- Indian male celebrity face identification and recognition☆14Jun 26, 2021Updated 4 years ago
- an analytics sdk for HTML5 app and web game☆10Dec 31, 2015Updated 10 years ago
- generative baubles☆24Dec 25, 2020Updated 5 years ago
- Node kickass.to json API wrapper☆21Jul 26, 2016Updated 9 years ago
- Deprecated Module: See Xponents or OpenSextantToolbox as active code base.☆31Jul 24, 2013Updated 12 years ago
- How to define, maintain and use a Mongoose database connection☆43Jun 4, 2024Updated last year
- it's a library for nodejs to dump http live stream☆24Feb 6, 2017Updated 9 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Searchly sample Node.js application☆20Nov 1, 2018Updated 7 years ago
- Small util to centralize and debounce window 'resize' events.☆24Jan 22, 2018Updated 8 years ago
- Lightweight node.js module to quickly search Apple's iTunes Store for music, movies, apps, etc.☆29Nov 21, 2025Updated 5 months ago
- Sometimes you just need to postion things on the surface of a sphere. Here are a few methods I've used over the years.☆22Oct 12, 2017Updated 8 years ago
- Provides Promises/A+ compliant versions of all your favorite AWS SDK clients.☆26May 22, 2017Updated 8 years ago
- ☆26Apr 17, 2021Updated 5 years ago
- Get the URL from a web shortcut file☆15Aug 14, 2021Updated 4 years ago
- node module and command-line program for accelerated (multiple connections) http download Stream☆30Jan 14, 2019Updated 7 years ago
- Flexible event driven crawler for node.☆2,133Mar 7, 2021Updated 5 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Credit card generator☆30Feb 18, 2023Updated 3 years ago
- Create a writable stream that writes to multiple other writeable streams☆30Mar 22, 2018Updated 8 years ago
- A simple API for searching the iTunes Artwork library built using Node.JS and Restify.☆21Oct 18, 2017Updated 8 years ago
- Web based SSH Terminal for Plesk☆14May 7, 2018Updated 7 years ago
- New RegExp Style for Node.js☆59Oct 14, 2013Updated 12 years ago
- ☆35Mar 4, 2019Updated 7 years ago
- A transform stream for glslify that replaces CSS-style hexadecimal colors with `vec3/vec4` definitions.☆35Oct 2, 2016Updated 9 years ago