monperrus / crawler-user-agentsLinks
Syntactic patterns of HTTP user-agents used by bots / robots / crawlers / scrapers / spiders. pull-request welcome
β1,303Updated last week
Alternatives and similar repositories for crawler-user-agents
Users that are interested in crawler-user-agents are comparing it to the libraries listed below
Sorting:
- π€/π¨βπ¦° Detect bots/crawlers/spiders using the user agent stringβ1,075Updated this week
- Daily updated repository for https://github.com/disposable/disposableβ540Updated this week
- Bot detection library that runs in the browser. Detects automation tools and frameworks. No server required, runs 100% on the client. MITβ¦β1,288Updated last month
- Cross-language temporary (disposable/throwaway) email detection library. Covers 55 734+ fake email providers.β1,791Updated 3 weeks ago
- A list of disposable email domainsβ1,352Updated 6 months ago
- Device information and digital fingerprinting written in pure JavaScript.β2,201Updated 2 years ago
- JavaScript detection of Incognito & other private browsing modes on Chrome, Edge, Safari, Brave, Firefox, Opera and MSIE.β460Updated last month
- β582Updated 6 months ago
- A free, open-source javascript fingerprinting libraryβ737Updated 3 weeks ago
- Is headless chrome currently detectable? Let's pit the detections and detection evasions against eachother.β659Updated 4 years ago
- reliable fake and temp email filter solution for site operatorsβ294Updated this week
- A JavaScript library for generating random user agents with data that's updated daily.β1,099Updated this week
- Luminati HTTP/HTTPS Proxy managerβ786Updated last week
- A database of free and disposable email domains and a handy Node.js module for querying it.β359Updated last year
- A proxy back end for Google Tag Manager & Google Analyticsβ255Updated 5 months ago
- A list of disposable/temporary email address domainsβ1,189Updated last month
- An open source list of ASNs known to belong to cloud, managed hosting, and colo facilities.β427Updated 7 months ago
- IP geolocation web serverβ739Updated 4 years ago
- JavaScript domain name parser based on the Public Suffix Listβ424Updated 5 months ago
- Easily create XML sitemaps for your website.β440Updated last year
- Access https://infosimples.github.io/detect-headless to run several headless detection tests against your browser.β296Updated 5 years ago
- This is a project for a browser fingerprinting technique that can track users not only within a single browser but also across different β¦β1,268Updated 3 years ago
- Fingerprinting script of Fingerprint-Scannerβ254Updated 6 months ago
- A precise user agent parser and device detector written in TypeScriptβ494Updated last year
- Splits a hostname into subdomains, domain and (effective) top-level domains.β512Updated last week
- The Public Suffix Listβ2,508Updated this week
- Sitemap-generating framework for node.jsβ1,624Updated 11 months ago
- Detects ad blockers (AdBlock, ...)β1,904Updated last year
- A list of temporary email providersβ1,147Updated 2 months ago
- An always up-to-date list of the top 100 HTTP user-agents most used over the Internet.β278Updated last week