monperrus / crawler-user-agentsLinks
Syntactic patterns of HTTP user-agents used by bots / robots / crawlers / scrapers / spiders. pull-request welcome
β1,325Updated 3 weeks ago
Alternatives and similar repositories for crawler-user-agents
Users that are interested in crawler-user-agents are comparing it to the libraries listed below
Sorting:
- π€/π¨βπ¦° Detect bots/crawlers/spiders using the user agent stringβ1,108Updated last month
- Bot detection library that runs in the browser. Detects automation tools and frameworks. No server required, runs 100% on the client. MITβ¦β1,335Updated last week
- Is headless chrome currently detectable? Let's pit the detections and detection evasions against eachother.β659Updated 4 years ago
- β590Updated 9 months ago
- Daily updated repository for https://github.com/disposable/disposableβ568Updated this week
- Device information and digital fingerprinting written in pure JavaScript.β2,211Updated 2 years ago
- A list of disposable email domainsβ1,355Updated 8 months ago
- JavaScript detection of Incognito & other private browsing modes on Chrome, Edge, Safari, Brave, Firefox, Opera and MSIE.β479Updated 2 months ago
- A proxy back end for Google Tag Manager & Google Analyticsβ256Updated 7 months ago
- A list of disposable/temporary email address domainsβ1,247Updated last week
- Block bad, possibly even malicious web crawlers (automated bots) using Nginxβ861Updated 5 years ago
- Access https://infosimples.github.io/detect-headless to run several headless detection tests against your browser.β299Updated 5 years ago
- Fingerprinting script of Fingerprint-Scannerβ256Updated 9 months ago
- reliable fake and temp email filter solution for site operatorsβ311Updated this week
- The ultimate guide on preventing Website Scrapingβ1,517Updated 2 years ago
- A free, open-source javascript fingerprinting libraryβ852Updated this week
- IP geolocation web serverβ739Updated 4 years ago
- The Public Suffix Listβ2,640Updated this week
- The main project repositoryβ445Updated this week
- Luminati HTTP/HTTPS Proxy managerβ805Updated last month
- An open source list of ASNs known to belong to cloud, managed hosting, and colo facilities.β444Updated 10 months ago
- A JavaScript library for generating random user agents with data that's updated daily.β1,131Updated 2 months ago
- Detects ad blockers (AdBlock, ...)β1,904Updated last year
- JavaScript domain name parser based on the Public Suffix Listβ429Updated 8 months ago
- Creepy device and browser fingerprintingβ2,141Updated this week
- IP Intelligence is a free Proxy VPN TOR and Bad IP detection tool to prevent Fraud, stolen content, and malicious users. Block proxies, Vβ¦β329Updated 2 months ago
- Nginx Block Bad Bots, Spam Referrer Blocker, Vulnerability Scanners, User-Agents, Malware, Adware, Ransomware, Malicious Sites, with antiβ¦β4,616Updated this week
- Cross-language temporary (disposable/throwaway) email detection library. Covers 55 734+ fake email providers.β1,826Updated 2 weeks ago
- Community-contributed list of referrer spammers. Comment +1 in any issue or Pull request and the spammer will be added to the list!β678Updated last week
- The world's easiest, smallest and powerful visitor identifier for browsers.β573Updated 3 months ago