medialab / uralLinks
A helper library full of URL-related heuristics.
☆73Updated last month
Alternatives and similar repositories for ural
Users that are interested in ural are comparing it to the libraries listed below
Sorting:
- Now included in rigour☆152Updated last month
- Web scraping Page Objects core library☆101Updated last week
- Extract networks of entities from journalistic reporting☆48Updated 2 years ago
- Extract text from HTML☆134Updated 5 years ago
- Fast and robust date extraction from web pages, with Python or on the command-line☆141Updated 2 months ago
- CoCrawler is a versatile web crawler built using modern tools and concurrency.☆191Updated 3 years ago
- A webmining CLI tool & library for python.☆339Updated last week
- API client for Aleph, supports bulk entity and document upload.☆28Updated last year
- Inspect a URL and estimate if it contains a news story☆38Updated 11 months ago
- Python based Wikidata framework for easy dataframe extraction☆45Updated last year
- Utility library to turn country names into ISO two-letter codes☆71Updated 2 months ago
- Ingestors extract the contents of mixed unstructured documents into structured (followthemoney) data.☆66Updated this week
- etl pipeline, graphical explorer and general toolbox for investigations with follow the money data☆23Updated 3 months ago
- Alternative robots parser module for Python☆20Updated last month
- URL normalization for Python☆99Updated 6 months ago
- Parse government documents into well formed JSON☆73Updated 2 months ago
- A tiny library for Python text normalisation. Useful for ad-hoc text processing.☆155Updated last month
- Link Wikidata items to large catalogs☆96Updated 2 weeks ago
- The most advanced debugging and testing tool for Scrapy☆16Updated 2 years ago
- Effortless conversion between data formats like JSON, XML and CSV☆120Updated 3 years ago
- Page Object pattern for Scrapy☆123Updated 2 weeks ago
- A pure-Python robots.txt parser with support for modern conventions.☆71Updated 3 months ago
- Detect and visualize text reuse☆119Updated last year
- ARGUS is an easy-to-use web scraping tool. The program is based on the Scrapy Python framework and is able to crawl a broad range of diff…☆89Updated 3 years ago
- Parse numbers written in natural language☆123Updated last year
- Add website scraping abilities to Datasette☆64Updated 2 years ago
- A toolkit for CDX indices such as Common Crawl and the Internet Archive's Wayback Machine☆185Updated last week
- A Python library for defining rule-based overrides on messy data☆16Updated last month
- Python wrapper for the MediaWiki API to access and parse data from Wikipedia☆42Updated last month
- A library to extract a publication date from a web page, along with a measure of the accuracy.☆41Updated 6 years ago