medialab / uralLinks
A helper library full of URL-related heuristics.
☆73Updated this week
Alternatives and similar repositories for ural
Users that are interested in ural are comparing it to the libraries listed below
Sorting:
- Now included in rigour☆152Updated 2 months ago
- Web scraping Page Objects core library☆104Updated 2 weeks ago
- Fast and robust date extraction from web pages, with Python or on the command-line☆145Updated 3 months ago
- Extract networks of entities from journalistic reporting☆49Updated 2 years ago
- Extract text from HTML☆134Updated 2 weeks ago
- A webmining CLI tool & library for python.☆352Updated this week
- Parse government documents into well formed JSON☆75Updated 3 weeks ago
- API client for Aleph, supports bulk entity and document upload.☆29Updated last year
- A maximum-strength name parser for record linkage.☆39Updated 5 months ago
- CoCrawler is a versatile web crawler built using modern tools and concurrency.☆193Updated 3 years ago
- Web interface for network analysis.☆21Updated 3 years ago
- Effortless conversion between data formats like JSON, XML and CSV☆119Updated 3 years ago
- etl pipeline, graphical explorer and general toolbox for investigations with follow the money data☆25Updated 6 months ago
- A tiny library for Python text normalisation. Useful for ad-hoc text processing.☆157Updated 4 months ago
- Ingestors extract the contents of mixed unstructured documents into structured (followthemoney) data.☆65Updated last month
- An automated, programming-free web scraper for interactive sites☆111Updated 2 years ago
- URL normalization for Python☆99Updated 9 months ago
- A library to extract a publication date from a web page, along with a measure of the accuracy.☆41Updated 6 years ago
- A Python library for defining rule-based overrides on messy data☆18Updated 2 months ago
- Inspect a URL and estimate if it contains a news story☆39Updated 3 weeks ago
- Homoglyphs: get similar letters, convert to ASCII, detect possible languages and UTF-8 group.☆84Updated 5 years ago
- Python based Wikidata framework for easy dataframe extraction☆45Updated 2 years ago
- Django Legal Advice Builder is a django app that can be used to create, edit and display multi-step questionaires and display the answers…☆12Updated 3 years ago
- Data cleaning and validation functions for names, languages, identifiers, etc.☆52Updated last week
- Clean, filter and sample URLs to optimize data collection – Python & command-line – Deduplication, spam, content and language filters☆158Updated last month
- python functions for applied use of schema.org☆38Updated 4 years ago
- Alternative robots parser module for Python☆20Updated 2 weeks ago
- Page Object pattern for Scrapy☆126Updated 2 weeks ago
- API for OpenSanctions with support for entity search and bulk matching of data collections. Supports Reconciliation API spec.☆122Updated this week
- A pure-Python robots.txt parser with support for modern conventions.☆79Updated last week