monperrus / crawler-user-agentsLinks
Syntactic patterns of HTTP user-agents used by bots / robots / crawlers / scrapers / spiders. pull-request welcome
β1,311Updated last month
Alternatives and similar repositories for crawler-user-agents
Users that are interested in crawler-user-agents are comparing it to the libraries listed below
Sorting:
- π€/π¨βπ¦° Detect bots/crawlers/spiders using the user agent stringβ1,096Updated this week
- JavaScript detection of Incognito & other private browsing modes on Chrome, Edge, Safari, Brave, Firefox, Opera and MSIE.β468Updated last month
- Daily updated repository for https://github.com/disposable/disposableβ551Updated this week
- Bot detection library that runs in the browser. Detects automation tools and frameworks. No server required, runs 100% on the client. MITβ¦β1,314Updated this week
- Device information and digital fingerprinting written in pure JavaScript.β2,206Updated 2 years ago
- The world's easiest, smallest and powerful visitor identifier for browsers.β565Updated 2 months ago
- A proxy back end for Google Tag Manager & Google Analyticsβ254Updated 6 months ago
- β586Updated 8 months ago
- A free, open-source javascript fingerprinting libraryβ775Updated last month
- The regex file necessary to build language ports of Browserscope's user agent parser.β798Updated 3 months ago
- A list of disposable email domainsβ1,352Updated 7 months ago
- Is headless chrome currently detectable? Let's pit the detections and detection evasions against eachother.β659Updated 4 years ago
- A list of disposable/temporary email address domainsβ1,222Updated 3 months ago
- Allows you to detect the extension AdBlock (and other)β625Updated 6 years ago
- Cross-language temporary (disposable/throwaway) email detection library. Covers 55 734+ fake email providers.β1,803Updated last week
- An open source list of ASNs known to belong to cloud, managed hosting, and colo facilities.β431Updated 8 months ago
- reliable fake and temp email filter solution for site operatorsβ307Updated this week
- Categorization of IP Addressesβ528Updated 2 years ago
- A JavaScript library for generating random user agents with data that's updated daily.β1,122Updated 2 weeks ago
- IP geolocation web serverβ738Updated 4 years ago
- The ultimate guide on preventing Website Scrapingβ1,517Updated last year
- The main project repositoryβ442Updated this week
- Splits a hostname into subdomains, domain and (effective) top-level domains.β514Updated last week
- Easily create XML sitemaps for your website.β443Updated last year
- List of major web + mobile browser user agent strings. +1 Bonus script to scrape :)β457Updated last year
- Access https://infosimples.github.io/detect-headless to run several headless detection tests against your browser.β298Updated 5 years ago
- Fingerprinting script of Fingerprint-Scannerβ256Updated 8 months ago
- A list of temporary email providersβ1,148Updated 3 months ago
- An easy way to check if users visiting your websites are bot or not.β96Updated 8 years ago
- IP geolocation web serverβ4,937Updated 3 years ago