medialab / ural
A helper library full of URL-related heuristics.
☆66Updated 5 months ago
Alternatives and similar repositories for ural:
Users that are interested in ural are comparing it to the libraries listed below
- Extract networks of entities from journalistic reporting☆48Updated last year
- Ingestors extract the contents of mixed unstructured documents into structured (followthemoney) data.☆59Updated last week
- Make it easier to compare and cross-reference the names of companies and people by applying strong normalisation.☆148Updated last month
- A library to extract a publication date from a web page, along with a measure of the accuracy.☆41Updated 5 years ago
- API client for Aleph, supports bulk entity and document upload.☆28Updated 5 months ago
- Web scraping Page Objects core library☆97Updated last month
- etl pipeline, graphical explorer and general toolbox for investigations with follow the money data☆15Updated last year
- A Python library for defining rule-based overrides on messy data☆13Updated 4 months ago
- Trying to generate name synonyms from wikidata☆32Updated 4 years ago
- Extract text from HTML☆134Updated 4 years ago
- A webmining CLI tool & library for python.☆308Updated last week
- Data cleaning and validation functions for names, languages, identifiers, etc.☆19Updated this week
- A base library for building web scrapers for statistical data, and a helper ontology for (primarily Swedish) statistical data.☆13Updated 3 weeks ago
- scraper for facebook, gab, google and tiktok☆22Updated 8 months ago
- Web interface for network analysis.☆21Updated 2 years ago
- An alpha project combining beneficial ownership and contracting data☆13Updated 3 years ago
- Specialized & performant CSV readers, writers and enrichers for python.☆13Updated last year
- DEPRECATED. Desktop graph visualization application☆50Updated 2 years ago
- A Python scraping module, that extracts text from articles found in RSS feeds. Uses SQLite as database.☆18Updated 8 months ago
- Frontend interface for Datashare, a self-hosted search engine for documents.☆34Updated this week
- Pluggable DSL that uses pipes to perform a series of linear transformations to extract data☆16Updated 8 months ago
- Alternative robots parser module for Python☆17Updated 3 weeks ago
- How can we improve name matching in screening tools?☆12Updated 2 months ago
- Inspect a URL and estimate if it contains a news story☆39Updated 4 months ago
- A maximum-strength name parser for record linkage.☆36Updated last month
- Extract city and country mentions from Text like GeoText without regex, but FlashText, a Aho-Corasick implementation.☆62Updated last week
- Fast and robust date extraction from web pages, with Python or on the command-line☆124Updated 2 months ago
- Command-line utility to help researchers collect video metadata from Youtube API☆29Updated 6 months ago
- Extract place names from a URL or text, and add context to those names -- for example distinguishing between a country, region or city.☆127Updated 11 months ago
- Python based Wikidata framework for easy dataframe extraction☆43Updated last year