monperrus / crawler-user-agentsLinks
Syntactic patterns of HTTP user-agents used by bots / robots / crawlers / scrapers / spiders. pull-request welcome
β1,344Updated last week
Alternatives and similar repositories for crawler-user-agents
Users that are interested in crawler-user-agents are comparing it to the libraries listed below
Sorting:
- π€/π¨βπ¦° Detect bots/crawlers/spiders using the user agent stringβ1,123Updated this week
- A list of disposable email domainsβ1,361Updated 10 months ago
- Free bot detection library that runs in the browser. Detects automation tools and frameworks. No server required, runs 100% on the clientβ¦β1,360Updated last week
- Cross-language temporary (disposable/throwaway) email detection library. Covers 55 734+ fake email providers.β1,847Updated 2 weeks ago
- Daily updated repository for https://github.com/disposable/disposableβ606Updated this week
- A list of disposable/temporary email address domainsβ1,289Updated last week
- A proxy back end for Google Tag Manager & Google Analyticsβ256Updated 9 months ago
- β591Updated last week
- Is headless chrome currently detectable? Let's pit the detections and detection evasions against eachother.β661Updated 4 years ago
- Allows you to detect the extension AdBlock (and other)β629Updated 6 years ago
- Easily create XML sitemaps for your website.β452Updated last year
- The Universal Device Detection library will parse any User Agent and detect the browser, operating system, device used (desktop, tablet, β¦β3,427Updated this week
- reliable fake and temp email filter solution for site operatorsβ325Updated this week
- JavaScript detection of Incognito & other private browsing modes on Chrome, Edge, Safari, Brave, Firefox, Opera and MSIE.β491Updated 4 months ago
- JavaScript domain name parser based on the Public Suffix Listβ430Updated 9 months ago
- Sitemap-generating framework for node.jsβ1,702Updated 3 weeks ago
- A free, open-source javascript fingerprinting libraryβ891Updated this week
- Community-contributed list of referrer spammers. Comment +1 in any issue or Pull request and the spammer will be added to the list!β679Updated last month
- Luminati HTTP/HTTPS Proxy managerβ811Updated last week
- Maxmind GEO Lookupβ639Updated 3 weeks ago
- Access https://infosimples.github.io/detect-headless to run several headless detection tests against your browser.β299Updated 5 years ago
- The world's easiest, smallest and powerful visitor identifier for browsers.β578Updated 5 months ago
- A JavaScript library for generating random user agents with data that's updated daily.β1,140Updated last month
- Categorization of IP Addressesβ528Updated 2 years ago
- A list of temporary email providersβ1,166Updated last week
- Splits a hostname into subdomains, domain and (effective) top-level domains.β514Updated last week
- Automatic PageSpeed optimization module for Nginxβ4,351Updated 2 years ago
- Implementation of canvas fingerprinting based on the Picasso paperβ156Updated last year
- Automated line item generator for Prebid.js and Google Ad Managerβ124Updated 2 months ago
- Small, cacheable and open version of Google Analytics JS clientβ637Updated 2 years ago