medialab / uralLinks
A helper library full of URL-related heuristics.
☆69Updated 2 months ago
Alternatives and similar repositories for ural
Users that are interested in ural are comparing it to the libraries listed below
Sorting:
- Web scraping Page Objects core library☆101Updated this week
- Now included in rigour☆151Updated 3 weeks ago
- Extract networks of entities from journalistic reporting☆48Updated last year
- API client for Aleph, supports bulk entity and document upload.☆28Updated 7 months ago
- Extract text from HTML☆135Updated 4 years ago
- Page Object pattern for Scrapy☆121Updated this week
- The most advanced debugging and testing tool for Scrapy☆16Updated 2 years ago
- Utility library to turn country names into ISO two-letter codes☆67Updated this week
- Inspect a URL and estimate if it contains a news story☆38Updated 6 months ago
- Platform for journalists to search, analyse, categorise and share unstructured data☆55Updated last month
- A library to extract a publication date from a web page, along with a measure of the accuracy.☆41Updated 5 years ago
- Ingestors extract the contents of mixed unstructured documents into structured (followthemoney) data.☆63Updated 3 weeks ago
- Alternative robots parser module for Python☆18Updated 2 months ago
- A Python scraping module, that extracts text from articles found in RSS feeds. Uses SQLite as database.☆19Updated 10 months ago
- A base library for building web scrapers for statistical data, and a helper ontology for (primarily Swedish) statistical data.☆13Updated 3 months ago
- etl pipeline, graphical explorer and general toolbox for investigations with follow the money data☆23Updated last year
- Python IMage MIning☆14Updated 2 months ago
- An alpha project combining beneficial ownership and contracting data☆13Updated 3 years ago
- Analyze scraped data☆46Updated 5 years ago
- Specialized & performant CSV readers, writers and enrichers for python.☆13Updated last year
- A maximum-strength name parser for record linkage.☆37Updated 3 weeks ago
- Schema.org classes in pydantic☆68Updated 2 years ago
- scraper for facebook, gab, google and tiktok☆21Updated 2 weeks ago
- how hard is it to get a list of all local news sites in the United States (LOL)☆8Updated 5 years ago
- Zyte API integration for Scrapy☆38Updated 2 weeks ago
- A Python library for defining rule-based overrides on messy data☆14Updated last month
- Estimating the age of web resources☆95Updated last year
- Fast and robust date extraction from web pages, with Python or on the command-line☆127Updated 5 months ago
- Dataset: BuzzFeed News “Trending” Strip, 2018–2023☆19Updated 2 years ago
- Save an RSS or ATOM feed to a SQLite database☆52Updated 2 years ago