monperrus / crawler-user-agentsLinks
Syntactic patterns of HTTP user-agents used by bots / robots / crawlers / scrapers / spiders. pull-request welcome
β1,304Updated last month
Alternatives and similar repositories for crawler-user-agents
Users that are interested in crawler-user-agents are comparing it to the libraries listed below
Sorting:
- π€/π¨βπ¦° Detect bots/crawlers/spiders using the user agent stringβ1,085Updated 2 weeks ago
- Bot detection library that runs in the browser. Detects automation tools and frameworks. No server required, runs 100% on the client. MITβ¦β1,301Updated last month
- Daily updated repository for https://github.com/disposable/disposableβ544Updated this week
- A list of disposable/temporary email address domainsβ1,207Updated 2 months ago
- β584Updated 7 months ago
- Access https://infosimples.github.io/detect-headless to run several headless detection tests against your browser.β299Updated 5 years ago
- Is headless chrome currently detectable? Let's pit the detections and detection evasions against eachother.β658Updated 4 years ago
- A list of disposable email domainsβ1,352Updated 6 months ago
- The regex file necessary to build language ports of Browserscope's user agent parser.β798Updated 3 months ago
- This is a project for a browser fingerprinting technique that can track users not only within a single browser but also across different β¦β1,269Updated 3 years ago
- A JavaScript library for generating random user agents with data that's updated daily.β1,114Updated this week
- Fingerprinting script of Fingerprint-Scannerβ255Updated 7 months ago
- reliable fake and temp email filter solution for site operatorsβ297Updated this week
- Device information and digital fingerprinting written in pure JavaScript.β2,204Updated 2 years ago
- The Public Suffix Listβ2,553Updated this week
- Allows you to detect the extension AdBlock (and other)β623Updated 6 years ago
- Luminati HTTP/HTTPS Proxy managerβ791Updated 3 weeks ago
- Whois server list for all top level domains.β325Updated 5 years ago
- Learn how identifiable you are on the Internetβ706Updated 5 years ago
- JavaScript domain name parser based on the Public Suffix Listβ425Updated 6 months ago
- Node.js implementation of a proxy server (think Squid) with support for SSL, authentication and upstream proxy chaining.β943Updated last week
- Cross-language temporary (disposable/throwaway) email detection library. Covers 55 734+ fake email providers.β1,796Updated last week
- An overpowered JavaScript browser fingerprinting library for creating persistent, unique and long-lasting digital fingerprints.β119Updated last year
- Small, cacheable and open version of Google Analytics JS clientβ639Updated 2 years ago
- A proxy back end for Google Tag Manager & Google Analyticsβ254Updated 5 months ago
- NGINX module for Brotli compressionβ2,191Updated last year
- The ultimate guide on preventing Website Scrapingβ1,517Updated last year
- Creepy device and browser fingerprintingβ2,043Updated 3 weeks ago
- The main project repositoryβ442Updated last week
- Puppeteer Pool, run a cluster of instances in parallelβ3,455Updated 3 months ago