medialab / ural

Related projects: ⓘ

• opensanctions / storyweb
  Extract networks of entities from journalistic reporting
  ☆46Updated last year
• alephdata / fingerprints
  Make it easier to compare and cross-reference the names of companies and people by applying strong normalisation.
  ☆142Updated 7 months ago
• alephdata / ingest-file
  Ingestors extract the contents of mixed unstructured documents into structured (followthemoney) data.
  ☆54Updated last month
• alephdata / alephclient
  API client for Aleph, supports bulk entity and document upload.
  ☆27Updated last month
• medialab / minivan
  Web interface for network analysis.
  ☆20Updated last year
• mediacloud / date_guesser
  A library to extract a publication date from a web page, along with a measure of the accuracy.
  ☆42Updated 5 years ago
• jplusplus / statscraper
  A base library for building web scrapers for statistical data, and a helper ontology for (primarily Swedish) statistical data.
  ☆13Updated last year
• andreburgaud / robotspy
  Alternative robots parser module for Python
  ☆16Updated this week
• andrewtavis / wikirepo
  Python based Wikidata framework for easy dataframe extraction
  ☆39Updated 9 months ago
• datawizard1337 / ARGUS
  ARGUS is an easy-to-use web scraping tool. The program is based on the Scrapy Python framework and is able to crawl a broad range of diff…
  ☆87Updated 2 years ago
• scrapinghub / web-poet
  Web scraping Page Objects core library
  ☆93Updated 2 months ago
• niczem / trawler
  scraper for facebook, gab, google and tiktok
  ☆22Updated 2 months ago
• palewire / storysniffer
  Inspect a URL and estimate if it contains a news story
  ☆39Updated 3 weeks ago
• mysociety / bluetail
  An alpha project combining beneficial ownership and contracting data
  ☆13Updated 3 years ago
• investigativedata / investigraph
  etl pipeline, graphical explorer and general toolbox for investigations with follow the money data
  ☆13Updated 8 months ago
• scrapy / protego
  A pure-Python robots.txt parser with support for modern conventions.
  ☆54Updated 3 months ago
• drkane / datasette-reconcile
  Adds a reconciliation API endpoint to Datasette, based on the Reconciliation Service API specification.
  ☆22Updated 7 months ago
• TeamHG-Memex / html-text
  Extract text from HTML
  ☆129Updated 4 years ago
• medialab / minet
  A webmining CLI tool & library for python.
  ☆277Updated last week
• J535D165 / recordlinkage-annotator
  A browser user interface for manual labeling of record pairs.
  ☆41Updated last year
• YaleDHLab / intertext
  Detect and visualize text reuse
  ☆115Updated 2 weeks ago
• ThomasAitken / Scrapy-Testmaster
  The most advanced debugging and testing tool for Scrapy
  ☆16Updated last year
• mediacloud / feed_seeker
  Find rss, atom, xml, and rdf feeds on webpages
  ☆30Updated last year
• alephdata / synonames
  Trying to generate name synonyms from wikidata
  ☆33Updated 4 years ago
• stanfordio / gabber
  Simple tool to pull posts and users from Gab
  ☆15Updated 2 months ago
• vaneseltine / nominally
  A maximum-strength name parser for record linkage.
  ☆29Updated last month
• medialab / casanova
  Specialized & performant CSV readers, writers and enrichers for python.
  ☆12Updated 7 months ago
• opensanctions / datapatch
  A Python library for defining rule-based overrides on messy data
  ☆11Updated 8 months ago
• adbar / htmldate
  Fast and robust date extraction from web pages, with Python or on the command-line
  ☆118Updated 2 weeks ago
• MuckRock / documentcloud
  DocumentCloud's back end source code - Please report bugs, issues and feature requests to info@documentcloud.org
  ☆32Updated this week