medialab / uralLinks
A helper library full of URL-related heuristics.
☆70Updated last month
Alternatives and similar repositories for ural
Users that are interested in ural are comparing it to the libraries listed below
Sorting:
- Now included in rigour☆151Updated 2 months ago
- Extract networks of entities from journalistic reporting☆48Updated last year
- Web scraping Page Objects core library☆102Updated 2 weeks ago
- Ingestors extract the contents of mixed unstructured documents into structured (followthemoney) data.☆66Updated 2 weeks ago
- etl pipeline, graphical explorer and general toolbox for investigations with follow the money data☆23Updated last year
- Fast and robust date extraction from web pages, with Python or on the command-line☆133Updated 6 months ago
- A library to extract a publication date from a web page, along with a measure of the accuracy.☆41Updated 5 years ago
- Alternative robots parser module for Python☆18Updated 3 weeks ago
- A maximum-strength name parser for record linkage.☆37Updated last month
- Parse government documents into well formed JSON☆70Updated 3 weeks ago
- Inspect a URL and estimate if it contains a news story☆39Updated 7 months ago
- Utility library to turn country names into ISO two-letter codes☆70Updated last month
- Extract text from HTML☆134Updated 4 years ago
- How can we improve name matching in screening tools?☆12Updated 5 months ago
- Web interface for network analysis.☆21Updated 2 years ago
- Python based Wikidata framework for easy dataframe extraction☆45Updated last year
- Tag news stories based on models trained on the NYT corpus.☆42Updated 2 years ago
- Add website scraping abilities to Datasette☆64Updated 2 years ago
- ARGUS is an easy-to-use web scraping tool. The program is based on the Scrapy Python framework and is able to crawl a broad range of diff…☆88Updated 3 years ago
- Data cleaning and validation functions for names, languages, identifiers, etc.☆28Updated this week
- API client for Aleph, supports bulk entity and document upload.☆28Updated 9 months ago
- https://mimesniff.spec.whatwg.org/ implementation for Python☆13Updated last year
- Ultimate Website Sitemap Parser☆222Updated 3 weeks ago
- A Python library for defining rule-based overrides on messy data☆15Updated 3 months ago
- python functions for applied use of schema.org☆37Updated 3 years ago
- Page Object pattern for Scrapy☆123Updated last week
- how hard is it to get a list of all local news sites in the United States (LOL)☆8Updated 5 years ago
- Effortless conversion between data formats like JSON, XML and CSV☆119Updated 3 years ago
- Clean, filter and sample URLs to optimize data collection – Python & command-line – Deduplication, spam, content and language filters☆142Updated 6 months ago
- A Python scraping module, that extracts text from articles found in RSS feeds. Uses SQLite as database.☆19Updated last year