Alternatives and similar repositories for crawler

Users that are interested in crawler are comparing it to the libraries listed below

• oodavid / puppeteer-scraper
  A Better Scraper, with Puppeteer
  ☆43Updated 3 weeks ago
• shenfe / puppeteer-service
  🎠 Run headless Chrome (aka Puppeteer) as a service.
  ☆49Updated 7 years ago
• apify / actor-scraper
  House of Apify Scrapers. Generic scraping actors with a simple UI to handle complex web crawling and scraping use cases.
  ☆121Updated 2 years ago
• yguan / ui-recorder
  ☆78Updated 10 years ago
• weld-io / scraping-service
  REST API for scraping dynamic websites using Node.js, headless Chrome and Cheerio.
  ☆64Updated 10 months ago
• HuddleEng / puppeteer-extensions
  Convenience functions for the Puppeteer
  ☆25Updated 2 years ago
• LasaleFamine / pupperender
  ExpressJs middleware for rendering PWA to bots using Puppeteer.
  ☆121Updated 2 weeks ago
• RapidAPI / rapidql
  Query multiple APIs and DBs and join them in a single query
  ☆136Updated 2 years ago
• saasify-sh / template-editor
  HTML template editor for quickly working with handlebars and liquid templates.
  ☆16Updated 2 years ago
• transitive-bullshit / puppeteer-render-text
  Robust text renderer using headless chrome.
  ☆66Updated last year
• anishkny / webgif
  Easily generate animated GIFs from websites
  ☆105Updated last year
• joseconstela / webparsy
  Node.JS library and cli for scraping websites using Puppeteer (or not) and YAML definitions
  ☆45Updated 2 years ago
• brendonboshell / supercrawler
  A web crawler. Supercrawler automatically crawls websites. Define custom handlers to parse content. Obeys robots.txt, rate limits and con…
  ☆379Updated 2 years ago
• zenato / docker-puppeteer
  Base environment image for Puppeteer (Headless Chrome Node API)
  ☆48Updated 2 years ago
• mawrkus / jason-the-miner
  ⛏ A versatile Web scraper for Node.js
  ☆45Updated 3 months ago
• NikolaiT / struktur
  Module that extracts structured information from a rendered html site and outputs JSON. HTML to JSON.
  ☆70Updated 4 years ago
• Tabueeee / puppeteer-request-spy
  Watch, fake or block requests from puppeteer matching patterns
  ☆49Updated 4 years ago
• pshihn / puppet-canvas
  HTML5 Canvas implementation for NodeJS backed by Puppeteer
  ☆65Updated 2 years ago
• appbaseio / dashboard
  ReactiveSearch cloud dashboard
  ☆32Updated last month
• transitive-bullshit / puppeteer-github
  GitHub automation driven by headless chrome.
  ☆19Updated 5 years ago
• tilakpatidar / bot-marvin
  Highly scalable crawler with best features.
  ☆11Updated 8 years ago
• actionhero / browser_fingerprint
  A node.js module to help identify browser sessions
  ☆59Updated last week
• Everettss / puppeteer-har
  Generate HAR file with puppeteer
  ☆164Updated last year
• ozum / sequelize-pg-generator
  Auto Create Sequelize ORM Models from PostgreSQL.
  ☆22Updated 7 years ago
• apostrophecms-legacy / apostrophe-multisite
  Multisite support for the Apostrophe CMS. Create & manage multiple sites with the same configuration and host them efficiently.
  ☆18Updated 5 months ago
• skorytnicki / chatblocks
  Declarative Messenger chatbot framework
  ☆54Updated last year
• hygraph / GraphQL-CMS
  ⚡️ GraphCMS is a GraphQL based Headless Content Management System
  ☆54Updated 8 years ago
• aofdev / instagram-get-images
  Instagram get images 🌄 (hashtags, account, locations) with puppeteer
  ☆76Updated 3 months ago
• itemsapi / elasticitems
  Higher level client for Elasticsearch written in Node.js oriented on facets and simplicity
  ☆20Updated 5 months ago
• prisma-archive / chromeless-playground
  ☆33Updated 7 years ago