Alternatives and similar repositories for crawler

Users that are interested in crawler are comparing it to the libraries listed below

• transitive-bullshit / puppeteer-render-text
  Robust text renderer using headless chrome.
  ☆66Updated last year
• anishkny / webgif
  Easily generate animated GIFs from websites
  ☆105Updated last year
• gajus / extract-email-address
  Extracts email address from an arbitrary text input.
  ☆62Updated 4 months ago
• oodavid / puppeteer-scraper
  A Better Scraper, with Puppeteer
  ☆43Updated last week
• apify / actor-scraper
  House of Apify Scrapers. Generic scraping actors with a simple UI to handle complex web crawling and scraping use cases.
  ☆121Updated 2 years ago
• itemsapi / elasticitems
  Higher level client for Elasticsearch written in Node.js oriented on facets and simplicity
  ☆20Updated 4 months ago
• HuddleEng / puppeteer-extensions
  Convenience functions for the Puppeteer
  ☆25Updated 2 years ago
• transitive-bullshit / puppeteer-github
  GitHub automation driven by headless chrome.
  ☆19Updated 4 years ago
• scopashq / typestream
  ⚡️ Next-generation data transformation framework for TypeScript that puts developer experience first
  ☆53Updated 3 years ago
• bda-research / floodesh
  Floodesh is a distributed web spider written with Nodejs.
  ☆13Updated 4 years ago
• jspri / request-x-ray
  Simple request driver for x-ray
  ☆14Updated 8 years ago
• christophebe / check-domain
  A simple component to check the status of a domain (whois, availability, expired, PR, TrustFlow, ...)
  ☆33Updated 8 years ago
• tilakpatidar / bot-marvin
  Highly scalable crawler with best features.
  ☆11Updated 8 years ago
• actionhero / browser_fingerprint
  A node.js module to help identify browser sessions
  ☆59Updated 2 weeks ago
• rrweb-io / rrweb-chrome-extension
  The chrome extension of rrweb which helps to run rrweb on any website out of box
  ☆19Updated 2 years ago
• pindlebot / airtable-node
  Node API for Airtable without the bloat (lodash, etc)
  ☆24Updated 5 years ago
• altaywtf / react-json-logic
  Build and evaluate JsonLogic with React components
  ☆25Updated 8 years ago
• kriasoft / pre-render
  Convert a single-page app (SPA) into a fully pre-rendered functional website before deploying it to a CDN
  ☆25Updated 7 years ago
• fritzh321 / logo-scrape
  🕷🚀 Scrapes/Crawls the logo from a provided url(s)/website for your Node.js applications.
  ☆48Updated 2 years ago
• Bartozzz / crawlerr
  A simple and fully customizable web crawler/spider for Node.js with server-side DOM. Comes with elegant and hell-simple APIs.
  ☆25Updated 3 years ago
• Agenty / browser-automation-api
  Browser automation API for repetitive web-based tasks, with a friendly user interface. You can use it to scrape content or do many other …
  ☆30Updated 3 years ago
• christian-fei / mega-scraper
  the mega scraper - scrape a website's content
  ☆27Updated 4 years ago
• microlinkhq / mql
  Microlink Query Language. The official HTTP client to interact with Microlink API for Node.js, browsers & Deno.
  ☆63Updated 2 weeks ago
• get-set-fetch / scraper
  Nodejs web scraper. Contains a command line, docker container, terraform module and ansible roles for distributed cloud scraping. Support…
  ☆114Updated 2 years ago
• joewhite86 / proxy-rotator
  Simple proxy rotation service
  ☆30Updated 9 years ago
• saasify-sh / synopsis
  Automagical summarization for webpages and articles. 🔥
  ☆45Updated 2 years ago
• apify / apify-actor-docker
  Base Docker images for Apify actors.
  ☆79Updated this week
• crawlbase / proxycrawl-node
  ProxyCrawl Node library for scraping and crawling
  ☆23Updated last year
• RemeJuan / social-automator
  A small node application to use to automate repetitive interactions on certain social networks
  ☆13Updated 4 years ago
• CannerCMS / graphql-rbac
  GraphQL Role-based access control (RBAC) middleware
  ☆38Updated 6 years ago