dibollinger / CookieBlock-Consent-CrawlerLinks
Webcrawler to collect cookie data and usage purposes, built using OpenWPM.
☆13Updated 2 years ago
Alternatives and similar repositories for CookieBlock-Consent-Crawler
Users that are interested in CookieBlock-Consent-Crawler are comparing it to the libraries listed below
Sorting:
- Toolchain to retrieve and parse privacy policies from websites as described in our paper "Unifying Privacy Policy Detection" by Henry Hos…☆17Updated 8 months ago
- Puppeteer based crawler to measure email and password exfiltration☆26Updated 3 years ago
- 🌐 List of free and downloadable top 1M domain list (alexa alternatives) 📊☆265Updated last year
- This repository contains lists of newly registered domain names updated daily.☆72Updated this week
- ☆12Updated 2 years ago
- Code for our 2023 IEEE S&P Paper "The Leaky Web: Automated Discovery of Cross-Site Information Leaks in Browsers and the Web"☆14Updated last year
- List of proxy IP addresses used by bots☆93Updated last week
- A collection of domain lists obtained from zone-walking TLDs. Updated daily.☆28Updated this week
- Crawler that retrieves commoncrawl's crawled hosts and their corresponding IPs☆21Updated 3 months ago
- Extract web archive data using Wayback Machine and Common Crawl☆165Updated last year
- 📝 This repository contains dumps of the monthly "Chrome UX Report" (CrUX) datasets.☆44Updated this week
- Historical website privacy policies spanning over two decades.☆139Updated 2 years ago
- Tranco: An improved top websites ranking☆166Updated 5 years ago
- A CI/CD-verified list of the internet's known-good public DNS servers (from public-dns.info) Updated weekly!☆32Updated this week
- This project aims to maintain Wappalyzer technologies☆435Updated this week
- AXFR all the things!☆27Updated 3 months ago
- ☆29Updated 3 years ago
- Certificate Transparency Community Website☆135Updated last week
- CSF Firewall and AbuseIPDB API integration with specific focus on data privacy and prevention of sensitive data leaked to public AbuseIPD…☆16Updated last year
- Effort to list and aggregate known malicious Google Chrome Extension IDs☆59Updated 3 years ago
- The open ransomware payment tracker☆102Updated 4 months ago
- This project aims to be a drop-in replacement for the certstream server by Calidog. This tool aggregates, parses, and streams certificate…☆179Updated last month
- SMTP honeypot written in Golang☆32Updated 9 years ago
- Various DNS dumps (daily new domains, FQDNs, etc.)☆23Updated this week
- Scan domains and receive advice based on their BIMI, DKIM, DMARC, and SPF records☆167Updated last month
- htpw is a project to increase the security of your WordPress!☆57Updated last year
- golang API and tools to interact with czds.icann.org☆80Updated 2 months ago
- Generate list of potential typo squatting domains with domain name permutation engine to feed AIL and other systems.☆102Updated 8 months ago
- IPv6 Internet Wide Scanning☆26Updated 9 months ago
- The Open Cookie Database is an effort to describe and categorise all major cookies. All cookie descriptions are saved in a downloadable C…☆275Updated 3 weeks ago