mediacloud / metadata-libLinks
How Media Cloud approaches extracting metadata from online news stories
☆15Updated 8 months ago
Alternatives and similar repositories for metadata-lib
Users that are interested in metadata-lib are comparing it to the libraries listed below
Sorting:
- Fast and robust date extraction from web pages, with Python or on the command-line☆138Updated last month
- Ultimate Website Sitemap Parser☆227Updated this week
- Article extraction benchmark: dataset and evaluation scripts☆322Updated last year
- Clean, filter and sample URLs to optimize data collection – Python & command-line – Deduplication, spam, content and language filters☆146Updated 8 months ago
- Target-dependent sentiment classification in news articles reporting on political events. Includes a high-quality data set of over 11k se…☆155Updated last month
- Python wrapper for google people-alos-ask☆107Updated last year
- A fork of Dragnet that also extract author, headline, date, keywords from context, as well as built in metadata extraction all in one pac…☆293Updated 3 months ago
- A webmining CLI tool & library for python.☆334Updated this week
- A python based HTML to text conversion library, command line client and Web service.☆322Updated last month
- News crawling with StormCrawler - stores content as WARC☆355Updated 6 months ago
- A spaCy wrapper of Entity-Fishing (component) for named entity disambiguation and linking on Wikidata☆164Updated 2 years ago
- This repository provides usage examples for the Python module Newspaper3k.☆148Updated last year
- A Python scraper for the Facebook Ad Library, using the official Facebook Ad Library API.☆123Updated 5 years ago
- A web scraper for TikTok using Playwright☆104Updated 4 months ago
- Index Common Crawl archives in tabular format☆122Updated last month
- Python port of Boilerpipe library☆92Updated last year
- Heuristic based boilerplate removal tool☆794Updated 6 months ago
- A spaCy wrapper of OpenTapioca for named entity linking on Wikidata☆94Updated 2 years ago
- Extraction of the journalistic five W and one H questions (5W1H) from news articles: who did what, when, where, why, and how?☆525Updated 10 months ago
- A machine learning tool for fishing entities☆266Updated 3 months ago
- Lightweight scraper for Google News☆340Updated 2 months ago
- A Flexible Deep Learning Approach to Fuzzy String Matching☆147Updated 11 months ago
- Legal document classification with EuroVoc descriptors on 22 languages.☆26Updated 2 years ago
- Annif is a multi-algorithm automated subject indexing tool for libraries, archives and museums.☆238Updated last week
- A toolkit for CDX indices such as Common Crawl and the Internet Archive's Wayback Machine☆183Updated 8 months ago
- All languages stopwords collection☆454Updated last year
- Facepager was made for fetching public available data from YouTube, Twitter and other websites on the basis of APIs and webscraping.☆529Updated last week
- A command-line utility and Scrapy middleware for scraping time series data from Archive.org's Wayback Machine.☆454Updated last year
- Simple multilingual lemmatizer for Python, especially useful for speed and efficiency☆172Updated 3 months ago
- Python Multilingual Ucrel Semantic Analysis System☆31Updated last year