Alternatives and similar repositories for crawler:

Users that are interested in crawler are comparing it to the libraries listed below

• transitive-bullshit / puppeteer-render-text
  Robust text renderer using headless chrome.
  ☆66Updated last year
• transitive-bullshit / puppeteer-github
  GitHub automation driven by headless chrome.
  ☆18Updated 4 years ago
• HuddleEng / puppeteer-extensions
  Convenience functions for the Puppeteer
  ☆25Updated 2 years ago
• joseconstela / webparsy
  Node.JS library and cli for scraping websites using Puppeteer (or not) and YAML definitions
  ☆44Updated 2 years ago
• pshihn / puppet-canvas
  HTML5 Canvas implementation for NodeJS backed by Puppeteer
  ☆65Updated last year
• bda-research / floodesh
  Floodesh is a distributed web spider written with Nodejs.
  ☆13Updated 4 years ago
• NikolaiT / struktur
  Module that extracts structured information from a rendered html site and outputs JSON. HTML to JSON.
  ☆70Updated 3 years ago
• christian-fei / mega-scraper
  the mega scraper - scrape a website's content
  ☆27Updated 4 years ago
• blakeembrey / node-htmlmetaparser
  A `htmlparser2` handler for parsing rich metadata from HTML. Includes HTML metadata, JSON-LD, RDFa, microdata, OEmbed, Twitter cards and …
  ☆54Updated last year
• aofdev / instagram-get-images
  Instagram get images 🌄 (hashtags, account, locations) with puppeteer
  ☆75Updated 3 weeks ago
• davidroman0O / moleculer-nextjs
  Add NextJS to Moleculer! 🎉
  ☆11Updated 6 years ago
• actionhero / browser_fingerprint
  A node.js module to help identify browser sessions
  ☆59Updated 2 weeks ago
• gajus / extract-email-address
  Extracts email address from an arbitrary text input.
  ☆62Updated 2 months ago
• eddyystop / feathers-live-query
  Live query. Mirror part of a DB on the client.
  ☆12Updated 8 years ago
• mudulo / subject-extractor
  ☆21Updated 5 years ago
• ozum / sequelize-pg-generator
  Auto Create Sequelize ORM Models from PostgreSQL.
  ☆22Updated 6 years ago
• christophebe / serp
  Google Search SERP Scraper
  ☆109Updated last year
• rrweb-io / rrweb-chrome-extension
  The chrome extension of rrweb which helps to run rrweb on any website out of box
  ☆19Updated 2 years ago
• gajus / extract-price
  Extracts prices from an arbitrary text input.
  ☆16Updated 6 years ago
• saasify-sh / template-editor
  HTML template editor for quickly working with handlebars and liquid templates.
  ☆16Updated 2 years ago
• urlbox / urlbox-node
  Capture website thumbnails using the urlbox screenshot as a service API in node
  ☆25Updated 6 months ago
• tilakpatidar / bot-marvin
  Highly scalable crawler with best features.
  ☆11Updated 8 years ago
• oodavid / puppeteer-scraper
  A Better Scraper, with Puppeteer
  ☆43Updated 5 months ago
• gajus / extract-time
  Extracts time from an arbitrary text input.
  ☆18Updated 5 years ago
• scopashq / typestream
  ⚡️ Next-generation data transformation framework for TypeScript that puts developer experience first
  ☆53Updated 3 years ago
• transitive-bullshit / koa2-mongoose-crud
  Koa 2 CRUD middleware for Mongoose models.
  ☆11Updated 2 years ago
• brendonboshell / supercrawler
  A web crawler. Supercrawler automatically crawls websites. Define custom handlers to parse content. Obeys robots.txt, rate limits and con…
  ☆380Updated 2 years ago
• transitive-bullshit / puppeteer-email
  Email automation driven by headless chrome.
  ☆166Updated 4 years ago
• lrlna / puppeteer-walker
  a puppeteer walker 🕷 🕸
  ☆79Updated 4 years ago
• notifme / notifme-template
  A Node.js library to easily handle all your notification templates.
  ☆31Updated 7 years ago