monperrus / crawler-user-agentsLinks
Syntactic patterns of HTTP user-agents used by bots / robots / crawlers / scrapers / spiders. pull-request welcome
☆1,347Updated 2 weeks ago
Alternatives and similar repositories for crawler-user-agents
Users that are interested in crawler-user-agents are comparing it to the libraries listed below
Sorting:
- Daily updated repository for https://github.com/disposable/disposable☆613Updated this week
- Free bot detection library that runs in the browser. Detects automation tools and frameworks. No server required, runs 100% on the client…☆1,367Updated 3 weeks ago
- Device information and digital fingerprinting written in pure JavaScript.☆2,216Updated 3 years ago
- Cross-language temporary (disposable/throwaway) email detection library. Covers 55 734+ fake email providers.☆1,852Updated last week
- A list of disposable email domains☆1,361Updated 10 months ago
- Self-hosted browser fingerprinting and bot detection with real-world constraints in mind.☆591Updated last week
- The regex file necessary to build language ports of Browserscope's user agent parser.☆812Updated 3 weeks ago
- JavaScript detection of Incognito & other private browsing modes on Chrome, Edge, Safari, Brave, Firefox, Opera and MSIE.☆494Updated 4 months ago
- A list of disposable/temporary email address domains☆1,301Updated 3 weeks ago
- Is headless chrome currently detectable? Let's pit the detections and detection evasions against eachother.☆661Updated 4 years ago
- A proxy back end for Google Tag Manager & Google Analytics☆258Updated 9 months ago
- Detects ad blockers (AdBlock, ...)☆1,904Updated last year
- Allows you to detect the extension AdBlock (and other)☆629Updated 6 years ago
- A list of temporary email providers☆1,166Updated 3 weeks ago
- An easy way to check if users visiting your websites are bot or not.☆98Updated 8 years ago
- A JavaScript library for generating random user agents with data that's updated daily.☆1,142Updated this week
- Block bad, possibly even malicious web crawlers (automated bots) using Nginx☆859Updated 5 years ago
- Automatic PageSpeed optimization module for Nginx☆4,351Updated 2 years ago
- reliable fake and temp email filter solution for site operators☆325Updated this week
- IP Intelligence is a free Proxy VPN TOR and Bad IP detection tool to prevent Fraud, stolen content, and malicious users. Block proxies, V…☆331Updated 2 months ago
- An open source list of ASNs known to belong to cloud, managed hosting, and colo facilities.☆485Updated last year
- Fingerprinting script of Fingerprint-Scanner☆257Updated 11 months ago
- Nginx Block Bad Bots, Spam Referrer Blocker, Vulnerability Scanners, User-Agents, Malware, Adware, Ransomware, Malicious Sites, with anti…☆4,667Updated this week
- JavaScript domain name parser based on the Public Suffix List☆435Updated 10 months ago
- NGINX module for Brotli compression☆2,215Updated last year
- This is a project for a browser fingerprinting technique that can track users not only within a single browser but also across different …☆1,270Updated 4 years ago
- Whois server list for all top level domains.☆327Updated 5 years ago
- The Open Cookie Database is an effort to describe and categorise all major cookies. All cookie descriptions are saved in a downloadable C…☆282Updated 3 weeks ago
- A database of free and disposable email domains and a handy Node.js module for querying it.☆365Updated last year
- Easily create XML sitemaps for your website.☆452Updated last year