Alternatives and similar repositories for crawler

Users that are interested in crawler are comparing it to the libraries listed below

• NikolaiT / struktur
  Module that extracts structured information from a rendered html site and outputs JSON. HTML to JSON.
  ☆70Updated 3 years ago
• oodavid / puppeteer-scraper
  A Better Scraper, with Puppeteer
  ☆43Updated 6 months ago
• bda-research / floodesh
  Floodesh is a distributed web spider written with Nodejs.
  ☆13Updated 4 years ago
• LasaleFamine / pupperender
  ExpressJs middleware for rendering PWA to bots using Puppeteer.
  ☆121Updated 3 months ago
• blakeembrey / node-htmlmetaparser
  A `htmlparser2` handler for parsing rich metadata from HTML. Includes HTML metadata, JSON-LD, RDFa, microdata, OEmbed, Twitter cards and …
  ☆55Updated last year
• HuddleEng / puppeteer-extensions
  Convenience functions for the Puppeteer
  ☆25Updated 2 years ago
• apify / actor-scraper
  House of Apify Scrapers. Generic scraping actors with a simple UI to handle complex web crawling and scraping use cases.
  ☆121Updated 2 years ago
• winkjs / wink-ner
  Language agnostic named entity recognizer
  ☆39Updated 2 years ago
• igniteram / facebook-birthday-cli
  Wish your facebook friends from command line, never miss the wish! http://npm.im/facebook-birthday-cli
  ☆58Updated 5 years ago
• aofdev / instagram-get-images
  Instagram get images 🌄 (hashtags, account, locations) with puppeteer
  ☆75Updated 2 months ago
• christophebe / check-domain
  A simple component to check the status of a domain (whois, availability, expired, PR, TrustFlow, ...)
  ☆33Updated 8 years ago
• zlurad / serp-parser
  Nodejs lib to parse Google SERP html pages
  ☆47Updated last year
• indix / web-auto-extractor
  Automatically extracts structured information from webpages
  ☆109Updated 2 years ago
• pshihn / puppet-canvas
  HTML5 Canvas implementation for NodeJS backed by Puppeteer
  ☆65Updated 2 years ago
• saumets / dockerized-puppeteer
  Example project demonstrating Headless Chrome + Puppeteer running in their own individual containers.
  ☆70Updated 2 years ago
• joseconstela / webparsy
  Node.JS library and cli for scraping websites using Puppeteer (or not) and YAML definitions
  ☆44Updated 2 years ago
• sweekson / puppeteer-samples
  JS samples using Puppeteer
  ☆19Updated 7 years ago
• csabapalfi / facebook-scrape-group
  🕸️ Scrape facebook group post permalinks
  ☆37Updated 2 years ago
• NikolaiT / scrapeulous
  Cloud crawler functions for scrapeulous
  ☆45Updated 4 years ago
• altaywtf / react-json-logic
  Build and evaluate JsonLogic with React components
  ☆25Updated 8 years ago
• mike442144 / seenreq
  Generate an object for testing if a request is sent, request is Mikeal's request.
  ☆44Updated 4 years ago
• christian-fei / mega-scraper
  the mega scraper - scrape a website's content
  ☆27Updated 4 years ago
• itemsapi / elasticitems
  Higher level client for Elasticsearch written in Node.js oriented on facets and simplicity
  ☆20Updated 3 months ago
• ozum / sequelize-pg-generator
  Auto Create Sequelize ORM Models from PostgreSQL.
  ☆22Updated 6 years ago
• actionhero / browser_fingerprint
  A node.js module to help identify browser sessions
  ☆59Updated last month
• bermi / element-xpath
  Gets a consistent xpath for a single DOM element.
  ☆63Updated 10 years ago
• indix / css-optimum-selector
  Helps to extract shortest optimal css-selector and multi-selector.
  ☆26Updated 7 years ago
• prisma-archive / chromeless-playground
  ☆33Updated 7 years ago
• itemsapi / starter
  Create vertical search web application in minutes with generator (based on ItemsAPI)
  ☆20Updated 7 years ago
• mawrkus / jason-the-miner
  ⛏ A versatile Web scraper for Node.js
  ☆45Updated 2 months ago