mediacloud / metadata-libLinks
How Media Cloud approaches extracting metadata from online news stories
☆15Updated 11 months ago
Alternatives and similar repositories for metadata-lib
Users that are interested in metadata-lib are comparing it to the libraries listed below
Sorting:
- Fast and robust date extraction from web pages, with Python or on the command-line☆142Updated last month
- Ultimate Website Sitemap Parser☆236Updated last week
- Python wrapper for google people-alos-ask☆107Updated last year
- Article extraction benchmark: dataset and evaluation scripts☆341Updated 2 months ago
- Target-dependent sentiment classification in news articles reporting on political events. Includes a high-quality data set of over 11k se…☆157Updated 5 months ago
- Legal document classification with EuroVoc descriptors on 22 languages.☆27Updated 2 years ago
- A simple module to collect video, text, and metadata from Tiktok.☆437Updated 2 months ago
- News crawling with StormCrawler - stores content as WARC☆360Updated 10 months ago
- This repository provides usage examples for the Python module Newspaper3k.☆148Updated last year
- Python port of Boilerpipe library☆96Updated last year
- Clean, filter and sample URLs to optimize data collection – Python & command-line – Deduplication, spam, content and language filters☆154Updated last month
- A spaCy wrapper of Entity-Fishing (component) for named entity disambiguation and linking on Wikidata☆169Updated 3 years ago
- Pushshift Telegram Ingest☆86Updated 6 years ago
- Index Common Crawl archives in tabular format☆124Updated 2 weeks ago
- A spaCy wrapper of OpenTapioca for named entity linking on Wikidata☆95Updated 2 years ago
- Example scripts for the pushshift dump files☆443Updated last month
- spaCy-wrap is a wrapper library for spaCy for including fine-tuned transformers from Huggingface in your spaCy pipeline allowing you to i…☆46Updated last year
- A toolkit for CDX indices such as Common Crawl and the Internet Archive's Wayback Machine☆194Updated 3 weeks ago
- A web scraper for TikTok using Playwright☆117Updated last week
- Asent is a python library for performing efficient and transparent sentiment analysis using spaCy.☆120Updated 2 months ago
- An easy to use python package for deep learning-based german sentiment classification.☆58Updated 3 years ago
- Heuristic based boilerplate removal tool☆810Updated 9 months ago
- A webmining CLI tool & library for python.☆345Updated this week
- A Python script to decode Google News article URLs.☆244Updated 7 months ago
- The 4CAT Capture and Analysis Toolkit provides modular data capture & analysis for a variety of social media platforms.☆346Updated last week
- Process Common Crawl data with Python and Spark☆450Updated last month
- A python based HTML to text conversion library, command line client and Web service.☆331Updated last month
- A small command line tool and set of functions for studying coordination networks in Twitter and other social media data.☆82Updated 3 years ago
- Extraction of the journalistic five W and one H questions (5W1H) from news articles: who did what, when, where, why, and how?☆528Updated last year
- A Flexible Deep Learning Approach to Fuzzy String Matching☆149Updated last year