medialab / uralLinks
A helper library full of URL-related heuristics.
☆72Updated 2 months ago
Alternatives and similar repositories for ural
Users that are interested in ural are comparing it to the libraries listed below
Sorting:
- Now included in rigour☆152Updated 2 weeks ago
- Fast and robust date extraction from web pages, with Python or on the command-line☆142Updated last month
- Web scraping Page Objects core library☆103Updated 2 weeks ago
- Extract networks of entities from journalistic reporting☆49Updated 2 years ago
- Extract text from HTML☆135Updated 5 years ago
- A webmining CLI tool & library for python.☆345Updated this week
- API client for Aleph, supports bulk entity and document upload.☆28Updated last year
- Alternative robots parser module for Python☆20Updated 2 weeks ago
- Ingestors extract the contents of mixed unstructured documents into structured (followthemoney) data.☆66Updated this week
- Python based Wikidata framework for easy dataframe extraction☆45Updated 2 years ago
- A maximum-strength name parser for record linkage.☆39Updated 3 months ago
- Inspect a URL and estimate if it contains a news story☆39Updated this week
- etl pipeline, graphical explorer and general toolbox for investigations with follow the money data☆23Updated 4 months ago
- Clean, filter and sample URLs to optimize data collection – Python & command-line – Deduplication, spam, content and language filters☆150Updated last month
- Parse government documents into well formed JSON☆74Updated this week
- python functions for applied use of schema.org☆36Updated 4 years ago
- URL normalization for Python☆99Updated 7 months ago
- Add website scraping abilities to Datasette☆66Updated 2 years ago
- A library to extract a publication date from a web page, along with a measure of the accuracy.☆41Updated 6 years ago
- An automated, programming-free web scraper for interactive sites☆111Updated 2 years ago
- Parse numbers written in natural language☆123Updated last year
- Effortless conversion between data formats like JSON, XML and CSV☆120Updated 3 years ago
- Data model and processing tools for investigative entity data☆255Updated last week
- API for OpenSanctions with support for entity search and bulk matching of data collections. Supports Reconciliation API spec.☆115Updated this week
- https://mimesniff.spec.whatwg.org/ implementation for Python☆13Updated last year
- CoCrawler is a versatile web crawler built using modern tools and concurrency.☆191Updated 3 years ago
- A Python library for defining rule-based overrides on messy data☆16Updated 2 weeks ago
- Spider templates for automatic crawlers.☆32Updated 2 months ago
- Datasette plugin for uploading CSV files and converting them to database tables☆27Updated last month
- Web interface for network analysis.☆21Updated 3 years ago