ReedD / crawlerLinks
Chromium / Puppeteer site crawler
☆49Updated 5 years ago
Alternatives and similar repositories for crawler
Users that are interested in crawler are comparing it to the libraries listed below
Sorting:
- House of Apify Scrapers. Generic scraping actors with a simple UI to handle complex web crawling and scraping use cases.☆128Updated 2 years ago
- Email automation driven by headless chrome.☆168Updated 4 years ago
- A web crawler. Supercrawler automatically crawls websites. Define custom handlers to parse content. Obeys robots.txt, rate limits and con…☆380Updated 2 years ago
- ExpressJs middleware for rendering PWA to bots using Puppeteer.☆121Updated 2 months ago
- Library and CLI for automating captcha verification across multiple providers.☆123Updated 5 years ago
- Easily generate animated GIFs from websites☆106Updated 2 years ago
- ☆79Updated 11 years ago
- Robust text renderer using headless chrome.☆66Updated last year
- A Better Scraper, with Puppeteer☆43Updated 2 months ago
- Puppeteer(Chrome headless node API) based web page renderer☆328Updated last year
- Nodejs web scraper. Contains a command line, docker container, terraform module and ansible roles for distributed cloud scraping. Support…☆112Updated 2 years ago
- ⛏ A versatile Web scraper for Node.js☆46Updated 3 weeks ago
- Extracts email address from an arbitrary text input.☆64Updated 8 months ago
- Benchmark of microservices frameworks for NodeJS☆40Updated 6 years ago
- Web crawler for Node.JS☆255Updated 7 years ago
- Watch, fake or block requests from puppeteer matching patterns☆49Updated 5 years ago
- Convenience functions for the Puppeteer☆25Updated 2 years ago
- HTML5 Canvas implementation for NodeJS backed by Puppeteer☆65Updated 2 years ago
- Create vertical search web application in minutes with generator (based on ItemsAPI)☆20Updated 7 years ago
- Web interface for PM2 built with react☆43Updated 4 years ago
- Example project demonstrating Headless Chrome + Puppeteer running in their own individual containers.☆70Updated 2 years ago
- Simple, lightweight and expressive web scraping with Node.js☆153Updated 4 years ago
- A simple component to check the status of a domain (whois, availability, expired, PR, TrustFlow, ...)☆33Updated 8 years ago
- Instagram get images 🌄 (hashtags, account, locations) with puppeteer☆79Updated last month
- Generate HAR file with puppeteer☆166Updated last year
- Minimalist node.js command-line & programmatic API client for imaginary☆109Updated 6 years ago
- Wish your facebook friends from command line, never miss the wish! http://npm.im/facebook-birthday-cli☆58Updated 6 years ago
- ⚡️ Next-generation data transformation framework for TypeScript that puts developer experience first☆53Updated 3 years ago
- A `htmlparser2` handler for parsing rich metadata from HTML. Includes HTML metadata, JSON-LD, RDFa, microdata, OEmbed, Twitter cards and …☆57Updated last year
- Automatically extracts structured information from webpages☆109Updated 3 years ago