monperrus / crawler-user-agentsLinks
Syntactic patterns of HTTP user-agents used by bots / robots / crawlers / scrapers / spiders. pull-request welcome
β1,347Updated 2 weeks ago
Alternatives and similar repositories for crawler-user-agents
Users that are interested in crawler-user-agents are comparing it to the libraries listed below
Sorting:
- π€/π¨βπ¦° Detect bots/crawlers/spiders using the user agent stringβ1,124Updated this week
- Daily updated repository for https://github.com/disposable/disposableβ613Updated this week
- Free bot detection library that runs in the browser. Detects automation tools and frameworks. No server required, runs 100% on the clientβ¦β1,372Updated this week
- A list of disposable/temporary email address domainsβ1,301Updated 3 weeks ago
- Self-hosted browser fingerprinting and bot detection with real-world constraints in mind.β591Updated last week
- JavaScript detection of Incognito & other private browsing modes on Chrome, Edge, Safari, Brave, Firefox, Opera and MSIE.β494Updated 4 months ago
- Cross-language temporary (disposable/throwaway) email detection library. Covers 55 734+ fake email providers.β1,852Updated last week
- reliable fake and temp email filter solution for site operatorsβ325Updated this week
- A list of disposable email domainsβ1,361Updated 10 months ago
- Block bad, possibly even malicious web crawlers (automated bots) using Nginxβ859Updated 5 years ago
- Device information and digital fingerprinting written in pure JavaScript.β2,216Updated 3 years ago
- Is headless chrome currently detectable? Let's pit the detections and detection evasions against eachother.β661Updated 4 years ago
- A free, open-source javascript fingerprinting libraryβ901Updated this week
- The regex file necessary to build language ports of Browserscope's user agent parser.β812Updated 3 weeks ago
- Access https://infosimples.github.io/detect-headless to run several headless detection tests against your browser.β299Updated 5 years ago
- The world's easiest, smallest and powerful visitor identifier for browsers.β581Updated 5 months ago
- Allows you to detect the extension AdBlock (and other)β629Updated 6 years ago
- NGINX module for Brotli compressionβ2,215Updated last year
- Fingerprinting script of Fingerprint-Scannerβ257Updated 11 months ago
- A list of temporary email providersβ1,166Updated 3 weeks ago
- Detects ad blockers (AdBlock, ...)β1,904Updated last year
- A proxy back end for Google Tag Manager & Google Analyticsβ258Updated 9 months ago
- Easily create XML sitemaps for your website.β452Updated last year
- A precise user agent parser and device detector written in TypeScriptβ499Updated 2 years ago
- The quickest way to run thumbor.β299Updated 2 months ago
- β158Updated 5 months ago
- Produces persistent, respawning "super" cookies in a browser, abusing over a dozen techniques. Its goal is to identify users after they'vβ¦β4,704Updated 9 months ago
- Implementation of canvas fingerprinting based on the Picasso paperβ157Updated last year
- AdBlock Detection Scriptsβ214Updated 6 years ago
- Chromium's HSTS preload list submission website.β845Updated 2 months ago