shirshak55 / scraper-tools

Related projects ⓘ

Alternatives and complementary repositories for scraper-tools

• clouedoc / puppeteer-extra-plugin-session
  Session persistence plugin for puppeteer-extra
  ☆21Updated 2 years ago
• unblocked-web / double-agent
  A test suite of common scraper detection techniques. See how detectable your scraper stack is.
  ☆135Updated 2 years ago
• fast-facts / puppeteer-pro
  A simple puppeteer wrapper to enable useful plugins with ease
  ☆54Updated this week
• apify / browser-pool
  A Node.js library to easily manage and rotate a pool of web browsers, using any of the popular browser automation libraries like Puppetee…
  ☆89Updated last year
• antoinevastel / bots-zoo
  ☆107Updated 7 months ago
• apify / fingerprint-generator
  Generates realistic browser fingerprints
  ☆68Updated 2 years ago
• apify / fingerprint-injector
  Home of fingerprint injector.
  ☆63Updated 2 years ago
• prescience-data / foundation
  🧱 A uniform template to use as a foundation for Puppeteer bot construction.
  ☆62Updated 3 years ago
• ulixee / unblocked
  A suite of tools for protecting the web's open knowledge.
  ☆130Updated last month
• antoinevastel / fp-collect
  Fingerprinting script of Fingerprint-Scanner
  ☆232Updated 7 months ago
• prescience-data / harden-puppeteer
  🛡🎭 A conceptual patch which modifies some vanilla puppeteer files to decrease detection rates.
  ☆46Updated 3 years ago
• serzz1990 / custom-chromium
  ☆31Updated 2 years ago
• NikolaiT / stealthy-scraping-tools
  Minimal set of tools to conduct stealthy scraping.
  ☆150Updated last year
• digitalhurricane-io / puppeteer-detection-100-percent
  How to detect puppeteer with 100% accuracy
  ☆101Updated 3 years ago
• chris124567 / puppeteer-bypassing-bot-detection
  Bypassing bot detection checks with Puppeteer.
  ☆94Updated 4 years ago
• chris124567 / commercial-bot-detectors
  JavaScript code of many commercial bot detectors/fingerprinting services and string deobfuscators for them if applicable.
  ☆122Updated 3 years ago
• transitive-bullshit / puppeteer-email
  Email automation driven by headless chrome.
  ☆164Updated 3 years ago
• gajus / puppeteer-proxy
  Proxies Puppeteer Page requests.
  ☆201Updated 2 months ago
• prescience-data / 4g-rotator
  📡 Renew the IP address of a tethered Android device via Node asynchronously.
  ☆76Updated last year
• transitive-bullshit / puppeteer-render-text
  Robust text renderer using headless chrome.
  ☆65Updated 11 months ago
• prescience-data / puppeteer-botcheck
  🕵‍♂ Bot detection tests for Puppeteer. Hide and seek!
  ☆83Updated last year
• piercefreeman / grooveproxy
  Groove, a crawling and unit test optimized MITM proxy server.
  ☆17Updated last year
• VaclavRut / actor-amazon-crawler
  Amazon crawler - this configuration will extract items for a keywords that you will specify in the input, and it will automatically extra…
  ☆72Updated 3 years ago
• get-set-fetch / scraper
  Nodejs web scraper. Contains a command line, docker container, terraform module and ansible roles for distributed cloud scraping. Support…
  ☆107Updated last year
• azerpas / detect-headless
  A web page that compiles methods used by Akamai, Datadome, and other bot detection solutions and WAF (Web Application Firewall) to identi…
  ☆43Updated 3 years ago
• prescience-data / secure-puppeteer
  🔐 Tooling to access Puppeteer's internal Isolated World.
  ☆18Updated 3 years ago
• reaz1995 / ghost-cursor-playwright
  Modification of actual ghost-cursor for puppeteer, with more functionality and rewrited to work well with playwight.
  ☆51Updated 10 months ago
• NikolaiT / struktur
  Module that extracts structured information from a rendered html site and outputs JSON. HTML to JSON.
  ☆69Updated 3 years ago
• jsoverson / shift-refactor
  A suite of utilities to query and modify JavaScript source
  ☆131Updated last year