Alternatives and similar repositories for crawler

Users that are interested in crawler are comparing it to the libraries listed below

• transitive-bullshit / puppeteer-email
  Email automation driven by headless chrome.
  ☆167Updated 5 years ago
• anishkny / webgif
  Easily generate animated GIFs from websites
  ☆106Updated 2 years ago
• apify / actor-scraper
  House of Apify Scrapers. Generic scraping actors with a simple UI to handle complex web crawling and scraping use cases.
  ☆128Updated this week
• get-set-fetch / scraper
  Nodejs web scraper. Contains a command line, docker container, terraform module and ansible roles for distributed cloud scraping. Support…
  ☆113Updated 2 years ago
• zlurad / serp-parser
  Nodejs lib to parse Google SERP html pages
  ☆46Updated 2 years ago
• HuddleEng / puppeteer-extensions
  Convenience functions for the Puppeteer
  ☆25Updated 2 years ago
• transitive-bullshit / puppeteer-render-text
  Robust text renderer using headless chrome.
  ☆66Updated 2 years ago
• mawrkus / jason-the-miner
  ⛏ A versatile Web scraper for Node.js
  ☆46Updated 2 weeks ago
• saumets / dockerized-puppeteer
  Example project demonstrating Headless Chrome + Puppeteer running in their own individual containers.
  ☆70Updated 3 years ago
• transitive-bullshit / captcha-solver
  Library and CLI for automating captcha verification across multiple providers.
  ☆121Updated 5 years ago
• brendonboshell / supercrawler
  A web crawler. Supercrawler automatically crawls websites. Define custom handlers to parse content. Obeys robots.txt, rate limits and con…
  ☆382Updated 3 years ago
• NikolaiT / scrapeulous
  Cloud crawler functions for scrapeulous
  ☆45Updated 4 years ago
• apify / apify-actor-docker
  Base Docker images for Apify actors.
  ☆90Updated this week
• actionhero / browser_fingerprint
  A node.js module to help identify browser sessions
  ☆61Updated last week
• LasaleFamine / pupperender
  ExpressJs middleware for rendering PWA to bots using Puppeteer.
  ☆120Updated 2 weeks ago
• oodavid / puppeteer-scraper
  A Better Scraper, with Puppeteer
  ☆43Updated last month
• yguan / ui-recorder
  ☆79Updated 11 years ago
• Agenty / browser-automation-api
  Browser automation API for repetitive web-based tasks, with a friendly user interface. You can use it to scrape content or do many other …
  ☆31Updated 4 years ago
• f9mac / puppeteer-extra-plugin-proxy
  A plugin for puppeteer-extra to add proxy support
  ☆18Updated 3 years ago
• Tabueeee / puppeteer-request-spy
  Watch, fake or block requests from puppeteer matching patterns
  ☆49Updated 5 years ago
• christophebe / check-domain
  A simple component to check the status of a domain (whois, availability, expired, PR, TrustFlow, ...)
  ☆33Updated 9 years ago
• christophebe / serp
  Google Search SERP Scraper
  ☆129Updated last month
• eeshi / node-scrapy
  Simple, lightweight and expressive web scraping with Node.js
  ☆153Updated 4 years ago
• zenato / puppeteer-renderer
  Puppeteer(Chrome headless node API) based web page renderer
  ☆329Updated last month
• aofdev / instagram-get-images
  Instagram get images 🌄 (hashtags, account, locations) with puppeteer
  ☆79Updated 2 months ago
• ChristianRich / phone-number-extractor
  Identifies and extracts phone numbers from arbitrary text
  ☆39Updated 8 years ago
• pshihn / puppet-canvas
  HTML5 Canvas implementation for NodeJS backed by Puppeteer
  ☆65Updated 2 years ago
• stiekel / aliexpress
  An AliExpress spider for Node
  ☆45Updated 8 years ago
• Everettss / puppeteer-har
  Generate HAR file with puppeteer
  ☆166Updated last year
• apilayer / scrapestack
  Real-Time Proxy & Web Scraping API
  ☆24Updated 6 years ago