medialab / ural
A helper library full of URL-related heuristics.
☆69Updated last month
Alternatives and similar repositories for ural:
Users that are interested in ural are comparing it to the libraries listed below
- Make it easier to compare and cross-reference the names of companies and people by applying strong normalisation.☆151Updated 3 months ago
- Extract networks of entities from journalistic reporting☆48Updated last year
- Web scraping Page Objects core library☆99Updated 2 months ago
- Ingestors extract the contents of mixed unstructured documents into structured (followthemoney) data.☆62Updated this week
- etl pipeline, graphical explorer and general toolbox for investigations with follow the money data☆23Updated last year
- Web interface for network analysis.☆21Updated 2 years ago
- API client for Aleph, supports bulk entity and document upload.☆28Updated 6 months ago
- A maximum-strength name parser for record linkage.☆37Updated this week
- Fast and robust date extraction from web pages, with Python or on the command-line☆126Updated 4 months ago
- Alternative robots parser module for Python☆17Updated 2 months ago
- python functions for applied use of schema.org☆36Updated 3 years ago
- Extract text from HTML☆135Updated 4 years ago
- Add website scraping abilities to Datasette☆62Updated 2 years ago
- Find rss, atom, xml, and rdf feeds on webpages☆30Updated 6 months ago
- A library to extract a publication date from a web page, along with a measure of the accuracy.☆41Updated 5 years ago
- A browser user interface for manual labeling of record pairs.☆47Updated last year
- A Python library for defining rule-based overrides on messy data☆13Updated 2 weeks ago
- A Python API to the Internet Archive Wayback Machine☆71Updated 8 months ago
- Python IMage MIning☆13Updated last month
- Specialized & performant CSV readers, writers and enrichers for python.☆13Updated last year
- How can we improve name matching in screening tools?☆12Updated 3 months ago
- URL normalization for Python☆94Updated last week
- A webmining CLI tool & library for python.☆320Updated last week
- Utility library to turn country names into ISO two-letter codes☆66Updated 2 months ago
- Schema.org classes in pydantic☆67Updated 2 years ago
- Data cleaning and validation functions for names, languages, identifiers, etc.☆20Updated this week
- Parse numbers written in natural language☆114Updated 6 months ago
- Inspect a URL and estimate if it contains a news story☆39Updated 5 months ago
- Clean, filter and sample URLs to optimize data collection – Python & command-line – Deduplication, spam, content and language filters☆137Updated 4 months ago
- Extract city and country mentions from Text like GeoText without regex, but FlashText, a Aho-Corasick implementation.☆62Updated last week