Alternatives and similar repositories for crawler

Users that are interested in crawler are comparing it to the libraries listed below

• apify / actor-scraper
  House of Apify Scrapers. Generic scraping actors with a simple UI to handle complex web crawling and scraping use cases.
  ☆128Updated 2 weeks ago
• LasaleFamine / pupperender
  ExpressJs middleware for rendering PWA to bots using Puppeteer.
  ☆121Updated last week
• aofdev / instagram-get-images
  Instagram get images 🌄 (hashtags, account, locations) with puppeteer
  ☆79Updated 3 weeks ago
• gajus / extract-email-address
  Extracts email address from an arbitrary text input.
  ☆64Updated 10 months ago
• yguan / ui-recorder
  ☆79Updated 11 years ago
• get-set-fetch / scraper
  Nodejs web scraper. Contains a command line, docker container, terraform module and ansible roles for distributed cloud scraping. Support…
  ☆112Updated 2 years ago
• brendonboshell / supercrawler
  A web crawler. Supercrawler automatically crawls websites. Define custom handlers to parse content. Obeys robots.txt, rate limits and con…
  ☆381Updated 2 years ago
• cheeaun / puppetron
  Puppeteer (Headless Chrome Node API)-based rendering solution.
  ☆545Updated 3 years ago
• zenato / puppeteer-renderer
  Puppeteer(Chrome headless node API) based web page renderer
  ☆328Updated this week
• oodavid / puppeteer-scraper
  A Better Scraper, with Puppeteer
  ☆43Updated 4 months ago
• actionhero / browser_fingerprint
  A node.js module to help identify browser sessions
  ☆61Updated last week
• anishkny / webgif
  Easily generate animated GIFs from websites
  ☆106Updated 2 years ago
• igniteram / facebook-birthday-cli
  Wish your facebook friends from command line, never miss the wish! http://npm.im/facebook-birthday-cli
  ☆58Updated 6 years ago
• pshihn / puppet-canvas
  HTML5 Canvas implementation for NodeJS backed by Puppeteer
  ☆65Updated 2 years ago
• itemsapi / starter
  Create vertical search web application in minutes with generator (based on ItemsAPI)
  ☆20Updated 7 years ago
• winkjs / wink-ner
  Language agnostic named entity recognizer
  ☆40Updated 2 years ago
• scopashq / typestream
  ⚡️ Next-generation data transformation framework for TypeScript that puts developer experience first
  ☆53Updated 3 years ago
• DataFire / Integrations
  Integration registry for DataFire
  ☆136Updated 2 years ago
• transitive-bullshit / puppeteer-render-text
  Robust text renderer using headless chrome.
  ☆66Updated 2 years ago
• icebob / microservices-benchmark
  Benchmark of microservices frameworks for NodeJS
  ☆40Updated 6 years ago
• joseconstela / webparsy
  Node.JS library and cli for scraping websites using Puppeteer (or not) and YAML definitions
  ☆47Updated 2 years ago
• Everettss / puppeteer-har
  Generate HAR file with puppeteer
  ☆166Updated last year
• shenfe / puppeteer-service
  🎠 Run headless Chrome (aka Puppeteer) as a service.
  ☆50Updated 7 years ago
• Tabueeee / puppeteer-request-spy
  Watch, fake or block requests from puppeteer matching patterns
  ☆49Updated 5 years ago
• NikolaiT / scrapeulous
  Cloud crawler functions for scrapeulous
  ☆45Updated 4 years ago
• amoilanen / js-crawler
  Web crawler for Node.JS
  ☆257Updated 7 years ago
• mawrkus / jason-the-miner
  ⛏ A versatile Web scraper for Node.js
  ☆46Updated last week
• saumets / dockerized-puppeteer
  Example project demonstrating Headless Chrome + Puppeteer running in their own individual containers.
  ☆70Updated 2 years ago
• saasify-sh / template-editor
  HTML template editor for quickly working with handlebars and liquid templates.
  ☆16Updated 2 years ago
• VaclavRut / actor-amazon-crawler
  Amazon crawler - this configuration will extract items for a keywords that you will specify in the input, and it will automatically extra…
  ☆77Updated 5 years ago