monperrus / crawler-user-agents
Syntactic patterns of HTTP user-agents used by bots / robots / crawlers / scrapers / spiders. pull-request welcome
β1,191Updated 3 weeks ago
Related projects β
Alternatives and complementary repositories for crawler-user-agents
- π€/π¨βπ¦° Detect bots/crawlers/spiders using the user agent stringβ937Updated this week
- A list of disposable email domainsβ1,253Updated last year
- Is headless chrome currently detectable? Let's pit the detections and detection evasions against eachother.β646Updated 3 years ago
- Whois server list for all top level domains.β317Updated 4 years ago
- β539Updated 8 months ago
- Bot detection library that runs in the browser. Detects automation tools and frameworks. No server required, runs 100% on the client. MITβ¦β1,057Updated this week
- A list of temporary email providersβ1,074Updated 2 weeks ago
- Daily updated repository for https://github.com/disposable/disposableβ434Updated this week
- Fingerprinting script of Fingerprint-Scannerβ232Updated 8 months ago
- Nginx GeoIP2 moduleβ976Updated 7 months ago
- Cross-language temporary (disposable/throwaway) email detection library. Covers 55 734+ fake email providers.β1,629Updated this week
- A list of disposable/temporary email address domainsβ948Updated 2 weeks ago
- A free, open-source javascript fingerprinting libraryβ355Updated this week
- a list of disposable and temporary email address domainsβ3,119Updated 3 weeks ago
- An open source list of ASNs known to belong to cloud, managed hosting, and colo facilities.β340Updated 2 weeks ago
- Learn how identifiable you are on the Internetβ688Updated 4 years ago
- The main project repositoryβ429Updated this week
- jpegoptim - utility to optimize/compress JPEG filesβ1,591Updated 3 months ago
- A list of role-based email addresses, used to detect whether an email address (e.g. team@domain.com) is likely not an individualβ73Updated 7 months ago
- Creepy device and browser fingerprintingβ1,568Updated last month
- The world's easiest, smallest and powerful visitor identifier for browsers.β417Updated 7 months ago
- An overpowered JavaScript browser fingerprinting library for creating persistent, unique and long-lasting digital fingerprints.β114Updated 3 months ago
- The quickest way to run thumbor.β281Updated last month
- Device information and digital fingerprinting written in pure JavaScript.β2,104Updated last year
- Implementation of canvas fingerprinting based on the Picasso paperβ140Updated 8 months ago
- Small, cacheable and open version of Google Analytics JS clientβ639Updated last year
- JavaScript Library to extract domains, subdomains and public suffixes from complex URIs.β484Updated this week
- A precise user agent parser and device detector written in TypeScriptβ464Updated 11 months ago
- Import any kind of server logs in Matomo for powerful log analytics. Universal log file parsing and reporting.β225Updated 5 months ago
- The ultimate guide on preventing Website Scrapingβ1,475Updated 11 months ago