medialab / uralLinks
A helper library full of URL-related heuristics.
☆70Updated 2 months ago
Alternatives and similar repositories for ural
Users that are interested in ural are comparing it to the libraries listed below
Sorting:
- Now included in rigour☆151Updated 2 weeks ago
- Web scraping Page Objects core library☆101Updated last week
- Extract text from HTML☆134Updated 5 years ago
- Fast and robust date extraction from web pages, with Python or on the command-line☆138Updated 3 weeks ago
- Extract networks of entities from journalistic reporting☆48Updated 2 years ago
- Alternative robots parser module for Python☆18Updated 2 months ago
- python functions for applied use of schema.org☆38Updated 3 years ago
- CoCrawler is a versatile web crawler built using modern tools and concurrency.☆190Updated 3 years ago
- Utility library to turn country names into ISO two-letter codes☆70Updated 3 weeks ago
- A webmining CLI tool & library for python.☆334Updated last week
- Inspect a URL and estimate if it contains a news story☆39Updated 9 months ago
- Python based Wikidata framework for easy dataframe extraction☆45Updated last year
- https://mimesniff.spec.whatwg.org/ implementation for Python☆13Updated last year
- etl pipeline, graphical explorer and general toolbox for investigations with follow the money data☆23Updated last month
- Ingestors extract the contents of mixed unstructured documents into structured (followthemoney) data.☆66Updated this week
- Link Wikidata items to large catalogs☆96Updated 5 months ago
- Parse numbers written in natural language☆122Updated 10 months ago
- API client for Aleph, supports bulk entity and document upload.☆28Updated 10 months ago
- Page Object pattern for Scrapy☆122Updated last week
- Effortless conversion between data formats like JSON, XML and CSV☆121Updated 3 years ago
- Python/Django based webapps and web user interfaces for search, structure (meta data management like thesaurus, ontologies, annotations a…☆99Updated 2 years ago
- A python based HTML to text conversion library, command line client and Web service.☆315Updated 3 weeks ago
- Python port of Boilerpipe library☆91Updated last year
- Spider templates for automatic crawlers.☆31Updated last month
- Ultimate Website Sitemap Parser☆225Updated 2 weeks ago
- A pure-Python robots.txt parser with support for modern conventions.☆70Updated last month
- Add website scraping abilities to Datasette☆64Updated 2 years ago
- A library to extract a publication date from a web page, along with a measure of the accuracy.☆41Updated 6 years ago
- Estimating the age of web resources☆96Updated 2 months ago
- Web interface for network analysis.☆21Updated 2 years ago