medialab / uralLinks
A helper library full of URL-related heuristics.
☆73Updated 3 months ago
Alternatives and similar repositories for ural
Users that are interested in ural are comparing it to the libraries listed below
Sorting:
- Now included in rigour☆152Updated last month
- Web scraping Page Objects core library☆104Updated 2 weeks ago
- Extract networks of entities from journalistic reporting☆49Updated 2 years ago
- Fast and robust date extraction from web pages, with Python or on the command-line☆142Updated 2 months ago
- A webmining CLI tool & library for python.☆344Updated 2 weeks ago
- Extract text from HTML☆135Updated 5 years ago
- API client for Aleph, supports bulk entity and document upload.☆29Updated last year
- API for OpenSanctions with support for entity search and bulk matching of data collections. Supports Reconciliation API spec.☆118Updated this week
- Ingestors extract the contents of mixed unstructured documents into structured (followthemoney) data.☆65Updated 2 weeks ago
- Data cleaning and validation functions for names, languages, identifiers, etc.☆50Updated this week
- etl pipeline, graphical explorer and general toolbox for investigations with follow the money data☆24Updated 5 months ago
- Inspect a URL and estimate if it contains a news story☆39Updated 2 weeks ago
- A maximum-strength name parser for record linkage.☆39Updated 4 months ago
- CoCrawler is a versatile web crawler built using modern tools and concurrency.☆191Updated 3 years ago
- Alternative robots parser module for Python☆20Updated 3 weeks ago
- Web interface for network analysis.☆21Updated 3 years ago
- Ultimate Website Sitemap Parser☆238Updated 3 weeks ago
- Add website scraping abilities to Datasette☆66Updated 2 years ago
- Lightweight web scraping toolkit for documents and structured data.☆315Updated last year
- Data model and processing tools for investigative entity data☆258Updated this week
- Python based Wikidata framework for easy dataframe extraction☆45Updated 2 years ago
- An alpha project combining beneficial ownership and contracting data☆13Updated 4 years ago
- Parse government documents into well formed JSON☆75Updated 2 weeks ago
- How can we improve name matching in screening tools?☆14Updated 4 months ago
- A library to extract a publication date from a web page, along with a measure of the accuracy.☆41Updated 6 years ago
- Clean, filter and sample URLs to optimize data collection – Python & command-line – Deduplication, spam, content and language filters☆155Updated 2 weeks ago
- A Python scraping module, that extracts text from articles found in RSS feeds. Uses SQLite as database.☆20Updated last year
- Platform for journalists to search, analyse, categorise and share unstructured data☆56Updated this week
- DocumentCloud's back end source code - Please report bugs, issues and feature requests to info@documentcloud.org☆42Updated last week
- ARGUS is an easy-to-use web scraping tool. The program is based on the Scrapy Python framework and is able to crawl a broad range of diff…☆89Updated 3 years ago