ReedD / crawlerLinks
Chromium / Puppeteer site crawler
☆49Updated 5 years ago
Alternatives and similar repositories for crawler
Users that are interested in crawler are comparing it to the libraries listed below
Sorting:
- House of Apify Scrapers. Generic scraping actors with a simple UI to handle complex web crawling and scraping use cases.☆125Updated 2 years ago
- Email automation driven by headless chrome.☆168Updated 4 years ago
- ExpressJs middleware for rendering PWA to bots using Puppeteer.☆121Updated 3 weeks ago
- Example project demonstrating Headless Chrome + Puppeteer running in their own individual containers.☆70Updated 2 years ago
- ⛏ A versatile Web scraper for Node.js☆45Updated last month
- Easily generate animated GIFs from websites☆105Updated last year
- Module that extracts structured information from a rendered html site and outputs JSON. HTML to JSON.☆70Updated 4 years ago
- Extracts email address from an arbitrary text input.☆64Updated 7 months ago
- ☆78Updated 11 years ago
- 🎠 Run headless Chrome (aka Puppeteer) as a service.☆49Updated 7 years ago
- A Better Scraper, with Puppeteer☆43Updated last month
- Robust text renderer using headless chrome.☆66Updated last year
- Base Docker images for Apify actors.☆85Updated this week
- HTML template editor for quickly working with handlebars and liquid templates.☆16Updated 2 years ago
- Puppeteer (Headless Chrome Node API)-based rendering solution.☆545Updated 3 years ago
- A node.js module to help identify browser sessions☆59Updated 2 weeks ago
- Integration registry for DataFire☆137Updated 2 years ago
- Simple, lightweight and expressive web scraping with Node.js☆153Updated 3 years ago
- Query multiple APIs and DBs and join them in a single query☆136Updated 2 years ago
- Puppeteer(Chrome headless node API) based web page renderer☆327Updated 11 months ago
- Library and CLI for automating captcha verification across multiple providers.☆123Updated 5 years ago
- GitHub automation driven by headless chrome.☆19Updated 5 years ago
- Watch, fake or block requests from puppeteer matching patterns☆49Updated 4 years ago
- Node.JS library and cli for scraping websites using Puppeteer (or not) and YAML definitions☆47Updated 2 years ago
- Higher level client for Elasticsearch written in Node.js oriented on facets and simplicity☆20Updated 2 weeks ago
- Automatically extracts structured information from webpages☆109Updated 3 years ago
- A simple component to check the status of a domain (whois, availability, expired, PR, TrustFlow, ...)☆33Updated 8 years ago
- Generate HAR file with puppeteer☆166Updated last year
- Benchmark of microservices frameworks for NodeJS☆40Updated 6 years ago
- Drop-in replacement for Airtable API with two-way sync backed by PostgreSQL. Graphql included.☆25Updated 6 years ago