medialab / uralLinks
A helper library full of URL-related heuristics.
☆70Updated 2 weeks ago
Alternatives and similar repositories for ural
Users that are interested in ural are comparing it to the libraries listed below
Sorting:
- Now included in rigour☆151Updated last week
- Web scraping Page Objects core library☆101Updated 3 weeks ago
- Extract networks of entities from journalistic reporting☆48Updated 2 years ago
- Extract text from HTML☆134Updated 5 years ago
- A webmining CLI tool & library for python.☆335Updated this week
- API client for Aleph, supports bulk entity and document upload.☆28Updated 11 months ago
- Fast and robust date extraction from web pages, with Python or on the command-line☆140Updated last month
- Utility library to turn country names into ISO two-letter codes☆71Updated last month
- Ingestors extract the contents of mixed unstructured documents into structured (followthemoney) data.☆66Updated 2 weeks ago
- Alternative robots parser module for Python☆19Updated 2 weeks ago
- Inspect a URL and estimate if it contains a news story☆39Updated 9 months ago
- etl pipeline, graphical explorer and general toolbox for investigations with follow the money data☆23Updated 2 months ago
- Parse government documents into well formed JSON☆73Updated last month
- A maximum-strength name parser for record linkage.☆38Updated 2 weeks ago
- https://mimesniff.spec.whatwg.org/ implementation for Python☆13Updated last year
- Page Object pattern for Scrapy☆121Updated 3 weeks ago
- An alpha project combining beneficial ownership and contracting data☆13Updated 4 years ago
- python functions for applied use of schema.org☆38Updated 3 years ago
- Effortless conversion between data formats like JSON, XML and CSV☆121Updated 3 years ago
- Homoglyphs: get similar letters, convert to ASCII, detect possible languages and UTF-8 group.☆83Updated 4 years ago
- An automated, programming-free web scraper for interactive sites☆111Updated 2 years ago
- CoCrawler is a versatile web crawler built using modern tools and concurrency.☆190Updated 3 years ago
- Python based Wikidata framework for easy dataframe extraction☆45Updated last year
- URL normalization for Python☆98Updated 4 months ago
- Add website scraping abilities to Datasette☆64Updated 2 years ago
- Frontend interface for Datashare, a self-hosted search engine for documents.☆38Updated this week
- A library to extract a publication date from a web page, along with a measure of the accuracy.☆41Updated 6 years ago
- Lightweight web scraping toolkit for documents and structured data.☆314Updated last year
- An open-source archive that gathers, saves, shares and analyzes news homepages☆144Updated 2 weeks ago
- Clean, filter and sample URLs to optimize data collection – Python & command-line – Deduplication, spam, content and language filters☆146Updated 8 months ago