Alternatives and similar repositories for crawler

Users that are interested in crawler are comparing it to the libraries listed below

• transitive-bullshit / puppeteer-email
  Email automation driven by headless chrome.
  ☆168Updated 4 years ago
• apify / actor-scraper
  House of Apify Scrapers. Generic scraping actors with a simple UI to handle complex web crawling and scraping use cases.
  ☆127Updated 2 years ago
• anishkny / webgif
  Easily generate animated GIFs from websites
  ☆106Updated last year
• NikolaiT / struktur
  Module that extracts structured information from a rendered html site and outputs JSON. HTML to JSON.
  ☆70Updated 4 years ago
• actionhero / browser_fingerprint
  A node.js module to help identify browser sessions
  ☆59Updated last week
• transitive-bullshit / puppeteer-render-text
  Robust text renderer using headless chrome.
  ☆66Updated last year
• zenato / puppeteer-renderer
  Puppeteer(Chrome headless node API) based web page renderer
  ☆326Updated last year
• HuddleEng / puppeteer-extensions
  Convenience functions for the Puppeteer
  ☆25Updated 2 years ago
• brendonboshell / supercrawler
  A web crawler. Supercrawler automatically crawls websites. Define custom handlers to parse content. Obeys robots.txt, rate limits and con…
  ☆378Updated 2 years ago
• yguan / ui-recorder
  ☆78Updated 11 years ago
• gajus / extract-email-address
  Extracts email address from an arbitrary text input.
  ☆64Updated 8 months ago
• oodavid / puppeteer-scraper
  A Better Scraper, with Puppeteer
  ☆43Updated last month
• transitive-bullshit / captcha-solver
  Library and CLI for automating captcha verification across multiple providers.
  ☆123Updated 5 years ago
• get-set-fetch / scraper
  Nodejs web scraper. Contains a command line, docker container, terraform module and ansible roles for distributed cloud scraping. Support…
  ☆112Updated 2 years ago
• apify / apify-actor-docker
  Base Docker images for Apify actors.
  ☆86Updated this week
• mawrkus / jason-the-miner
  ⛏ A versatile Web scraper for Node.js
  ☆45Updated last week
• indix / web-auto-extractor
  Automatically extracts structured information from webpages
  ☆109Updated 3 years ago
• saumets / dockerized-puppeteer
  Example project demonstrating Headless Chrome + Puppeteer running in their own individual containers.
  ☆70Updated 2 years ago
• shenfe / puppeteer-service
  🎠 Run headless Chrome (aka Puppeteer) as a service.
  ☆50Updated 7 years ago
• christophebe / check-domain
  A simple component to check the status of a domain (whois, availability, expired, PR, TrustFlow, ...)
  ☆33Updated 8 years ago
• saasify-sh / synopsis
  Automagical summarization for webpages and articles. 🔥
  ☆45Updated 2 years ago
• itemsapi / starter
  Create vertical search web application in minutes with generator (based on ItemsAPI)
  ☆20Updated 7 years ago
• scopashq / typestream
  ⚡️ Next-generation data transformation framework for TypeScript that puts developer experience first
  ☆53Updated 3 years ago
• christophebe / serp
  Google Search SERP Scraper
  ☆115Updated 2 years ago
• itemsapi / elasticitems
  Higher level client for Elasticsearch written in Node.js oriented on facets and simplicity
  ☆20Updated last month
• aofdev / instagram-get-images
  Instagram get images 🌄 (hashtags, account, locations) with puppeteer
  ☆78Updated 3 weeks ago
• veliovgroup / ostrio
  ▲ SEO Middleware • Web Analytics • Web CRON • WebSec • HTTP & SNMP Monitoring • ostr.io is a unified web-services platform
  ☆70Updated 3 weeks ago
• zlurad / serp-parser
  Nodejs lib to parse Google SERP html pages
  ☆47Updated 2 years ago
• eeshi / node-scrapy
  Simple, lightweight and expressive web scraping with Node.js
  ☆153Updated 3 years ago
• igniteram / facebook-birthday-cli
  Wish your facebook friends from command line, never miss the wish! http://npm.im/facebook-birthday-cli
  ☆58Updated 6 years ago