Alternatives and similar repositories for polipy

Users that are interested in polipy are comparing it to the libraries listed below

• ITSec-Uni-Muenster / Unifying-Privacy-Policy-Detection
  Toolchain to retrieve and parse privacy policies from websites as described in our paper "Unifying Privacy Policy Detection" by Henry Hos…
  ☆17Updated 9 months ago
• citp / privacy-policy-historical
  Historical website privacy policies spanning over two decades.
  ☆140Updated 2 years ago
• commoncrawl / cc-webgraph
  Tools to construct and process Common Crawl webgraphs
  ☆104Updated 3 weeks ago
• openwpm / openwpm-crawler
  A crawler that uses OpenWPM.
  ☆12Updated 4 years ago
• ercexpo / us-news-domains
  A list of over 5000 US news domains and their social media accounts
  ☆48Updated 2 years ago
• citp / email_tracking
  Code and data release for our PETS 2018 paper: "I never signed up for this! Privacy implications of email tracking".
  ☆46Updated 3 years ago
• mozilla / trackingprotection-tools
  A collection of tools for working with and analyzing Tracking Protection as implemented in Firefox
  ☆19Updated 2 years ago
• oduwsdl / CarbonDate
  Estimating the age of web resources
  ☆97Updated 7 months ago
• hynky1999 / CmonCrawl
  Common crawl extractor
  ☆84Updated last year
• freelawproject / courts-db
  A database of courts, tests and other experiments
  ☆98Updated 2 weeks ago
• CybersecurityForDemocracy / social-media-collector
  A browser extension to share data about your social feed with researchers and journalists to increase transparency.
  ☆86Updated 2 years ago
• cornelltech / TeachingTrustSafety
  Trust and Safety Teaching Consortium
  ☆82Updated 3 months ago
• commoncrawl / cc-crawl-statistics
  Statistics of Common Crawl monthly archives mined from URL index files
  ☆208Updated this week
• jdallen83 / sm_content_clustering
  A Python module for clustering creators of social media content into networks
  ☆74Updated 4 years ago
• adbar / htmldate
  Fast and robust date extraction from web pages, with Python or on the command-line
  ☆143Updated 2 months ago
• pushshift / telegram
  Pushshift Telegram Ingest
  ☆85Updated 6 years ago
• AFP-Medialab / verification-plugin
  A verification “Swiss army knife” helping journalists, fact-checkers, and human rights defenders to save time and be more efficient in th…
  ☆40Updated last week
• digitalmethodsinitiative / zeeschuimer
  A browser extension to collect social media data with.
  ☆314Updated this week
• undp / iVerify-Apps
  iVerify Apps: Apps that support the AI-powered iVerify platform to combat misinformation and hate speech
  ☆31Updated last week
• akamhy / waybackpy
  Wayback Machine API interface & a command-line tool
  ☆557Updated last year
• osome-iu / hoaxy-frontend
  Frontend component for Hoaxy, a tool to visualize the spread of claims and fact checking
  ☆73Updated 3 years ago
• commoncrawl / cdx_toolkit
  A toolkit for CDX indices such as Common Crawl and the Internet Archive's Wayback Machine
  ☆196Updated this week
• commoncrawl / cc-index-table
  Index Common Crawl archives in tabular format
  ☆124Updated 3 weeks ago
• sangaline / scrapy-wayback-machine
  A Scrapy middleware for scraping time series data from Archive.org's Wayback Machine.
  ☆121Updated last year
• DistriNet / tranco-list
  Tranco: An improved top websites ranking
  ☆169Updated 5 years ago
• medialab / ural
  A helper library full of URL-related heuristics.
  ☆73Updated 3 months ago
• travisbrown / twitter-watch
  Tracking the far right on Twitter
  ☆63Updated 2 years ago
• fabiogiglietto / CooRnet
  Given a set of URLs, this packages detects coordinated link sharing behavior on social media and outputs the network of entities that per…
  ☆75Updated last year
• scrapinghub / article-extraction-benchmark
  Article extraction benchmark: dataset and evaluation scripts
  ☆346Updated 3 months ago
• brandonrobertz / autoscrape-py
  An automated, programming-free web scraper for interactive sites
  ☆111Updated 2 years ago