medialab / uralLinks
A helper library full of URL-related heuristics.
☆73Updated last month
Alternatives and similar repositories for ural
Users that are interested in ural are comparing it to the libraries listed below
Sorting:
- Now included in rigour☆153Updated 2 months ago
- Fast and robust date extraction from web pages, with Python or on the command-line☆142Updated 2 weeks ago
- Web scraping Page Objects core library☆102Updated 3 weeks ago
- Extract networks of entities from journalistic reporting☆48Updated 2 years ago
- A webmining CLI tool & library for python.☆341Updated this week
- Extract text from HTML☆134Updated 5 years ago
- Utility library to turn country names into ISO two-letter codes☆71Updated 3 months ago
- Ingestors extract the contents of mixed unstructured documents into structured (followthemoney) data.☆66Updated 2 weeks ago
- URL normalization for Python☆99Updated 6 months ago
- A tiny library for Python text normalisation. Useful for ad-hoc text processing.☆157Updated 2 months ago
- A maximum-strength name parser for record linkage.☆39Updated 2 months ago
- Effortless conversion between data formats like JSON, XML and CSV☆120Updated 3 years ago
- Platform for journalists to search, analyse, categorise and share unstructured data☆56Updated this week
- etl pipeline, graphical explorer and general toolbox for investigations with follow the money data☆23Updated 4 months ago
- python functions for applied use of schema.org☆36Updated 4 years ago
- Alternative robots parser module for Python☆20Updated last week
- Inspect a URL and estimate if it contains a news story☆38Updated 2 weeks ago
- CoCrawler is a versatile web crawler built using modern tools and concurrency.☆191Updated 3 years ago
- Python based Wikidata framework for easy dataframe extraction☆45Updated last year
- API client for Aleph, supports bulk entity and document upload.☆28Updated last year
- A Python library for defining rule-based overrides on messy data☆16Updated 2 months ago
- Homoglyphs: get similar letters, convert to ASCII, detect possible languages and UTF-8 group.☆84Updated 4 years ago
- Spider templates for automatic crawlers.☆32Updated last month
- A pure-Python robots.txt parser with support for modern conventions.☆72Updated last week
- Ultimate Website Sitemap Parser☆231Updated 2 weeks ago
- How can we improve name matching in screening tools?☆14Updated 3 months ago
- Page Object pattern for Scrapy☆123Updated last month
- Lightweight web scraping toolkit for documents and structured data.☆314Updated last year
- Save an RSS or ATOM feed to a SQLite database☆57Updated 3 weeks ago
- Parse numbers written in natural language☆123Updated last year