monperrus / crawler-user-agentsLinks
Syntactic patterns of HTTP user-agents used by bots / robots / crawlers / scrapers / spiders. pull-request welcome
β1,279Updated 3 weeks ago
Alternatives and similar repositories for crawler-user-agents
Users that are interested in crawler-user-agents are comparing it to the libraries listed below
Sorting:
- π€/π¨βπ¦° Detect bots/crawlers/spiders using the user agent stringβ1,026Updated 3 weeks ago
- Bot detection library that runs in the browser. Detects automation tools and frameworks. No server required, runs 100% on the client. MITβ¦β1,229Updated 3 months ago
- Splits a hostname into subdomains, domain and (effective) top-level domains.β511Updated 4 months ago
- Whois server list for all top level domains.β321Updated 4 years ago
- π· CrawlerDetect is a PHP class for detecting bots/crawlers/spiders via the user agentβ2,076Updated 3 months ago
- Allows you to detect the extension AdBlock (and other)β622Updated 6 years ago
- Is headless chrome currently detectable? Let's pit the detections and detection evasions against eachother.β658Updated 4 years ago
- Browser sniffing gone too far β A useragent parser library for PHPβ1,828Updated last year
- JavaScript domain name parser based on the Public Suffix Listβ410Updated last month
- Cross-language temporary (disposable/throwaway) email detection library. Covers 55 734+ fake email providers.β1,758Updated last week
- Categorization of IP Addressesβ528Updated 2 years ago
- Nginx GeoIP2 moduleβ1,043Updated last year
- Demo of tracking using etags instead of cookies (or localstorage or anything else)β1,193Updated 2 months ago
- The Public Suffix Listβ2,384Updated this week
- reliable fake and temp email filter solution for site operatorsβ268Updated this week
- A free, open-source javascript fingerprinting libraryβ635Updated this week
- Daily updated repository for https://github.com/disposable/disposableβ512Updated this week
- Collection of scripts, thoughts about CSP (Content Security Policy)β499Updated 10 months ago
- Device information and digital fingerprinting written in pure JavaScript.β2,165Updated 2 years ago
- Nginx Block Bad Bots, Spam Referrer Blocker, Vulnerability Scanners, User-Agents, Malware, Adware, Ransomware, Malicious Sites, with antiβ¦β4,382Updated this week
- Launch Google Chrome with ease from node.β1,312Updated last month
- The world's easiest, smallest and powerful visitor identifier for browsers.β486Updated last year
- JavaScript object that creates unique CSS selector for given element.β562Updated this week
- Luminati HTTP/HTTPS Proxy managerβ771Updated 4 months ago
- Fingerprinting script of Fingerprint-Scannerβ249Updated 3 months ago
- A JavaScript library for generating random user agents with data that's updated daily.β1,055Updated this week
- β576Updated 3 months ago
- IP geolocation web serverβ736Updated 3 years ago
- This is a project for a browser fingerprinting technique that can track users not only within a single browser but also across different β¦β1,270Updated 3 years ago
- Learn how identifiable you are on the Internetβ698Updated 4 years ago