medialab / ural
A helper library full of URL-related heuristics.
☆64Updated 3 months ago
Alternatives and similar repositories for ural:
Users that are interested in ural are comparing it to the libraries listed below
- Make it easier to compare and cross-reference the names of companies and people by applying strong normalisation.☆147Updated last week
- Extract networks of entities from journalistic reporting☆47Updated last year
- API client for Aleph, supports bulk entity and document upload.☆28Updated 3 months ago
- Web scraping Page Objects core library☆95Updated 3 months ago
- Ingestors extract the contents of mixed unstructured documents into structured (followthemoney) data.☆58Updated this week
- A library to extract a publication date from a web page, along with a measure of the accuracy.☆42Updated 5 years ago
- Extract text from HTML☆133Updated 4 years ago
- Web interface for network analysis.☆21Updated 2 years ago
- python functions for applied use of schema.org☆35Updated 3 years ago
- ARGUS is an easy-to-use web scraping tool. The program is based on the Scrapy Python framework and is able to crawl a broad range of diff…☆88Updated 3 years ago
- A pure-Python robots.txt parser with support for modern conventions.☆57Updated 2 months ago
- scraper for facebook, gab, google and tiktok☆22Updated 6 months ago
- Homoglyphs: get similar letters, convert to ASCII, detect possible languages and UTF-8 group.☆79Updated 4 years ago
- etl pipeline, graphical explorer and general toolbox for investigations with follow the money data☆14Updated last year
- Utility library to turn country names into ISO two-letter codes☆66Updated last month
- An alpha project combining beneficial ownership and contracting data☆13Updated 3 years ago
- Trying to generate name synonyms from wikidata☆33Updated 4 years ago
- Extract city and country mentions from Text like GeoText without regex, but FlashText, a Aho-Corasick implementation.☆60Updated this week
- Scrapy middleware which allows to crawl only new content☆79Updated 2 years ago
- Alternative robots parser module for Python☆17Updated last month
- Page Object pattern for Scrapy☆119Updated 3 weeks ago
- Inspect a URL and estimate if it contains a news story☆39Updated last month
- https://mimesniff.spec.whatwg.org/ implementation for Python☆14Updated last year
- A webmining CLI tool & library for python.☆294Updated this week
- International Address formatter which considers the standard formatting rules of the country☆26Updated 3 years ago
- A Python library for defining rule-based overrides on messy data☆13Updated last month
- Fast and robust date extraction from web pages, with Python or on the command-line☆121Updated 2 weeks ago
- Zyte API integration for Scrapy☆37Updated this week
- Analyze scraped data☆47Updated 5 years ago