mediacloud / metadata-libLinks
How Media Cloud approaches extracting metadata from online news stories
☆15Updated 11 months ago
Alternatives and similar repositories for metadata-lib
Users that are interested in metadata-lib are comparing it to the libraries listed below
Sorting:
- Fast and robust date extraction from web pages, with Python or on the command-line☆142Updated 3 weeks ago
- Ultimate Website Sitemap Parser☆233Updated 3 weeks ago
- Article extraction benchmark: dataset and evaluation scripts☆339Updated 2 months ago
- A fork of Dragnet that also extract author, headline, date, keywords from context, as well as built in metadata extraction all in one pac…☆297Updated 6 months ago
- A webmining CLI tool & library for python.☆342Updated last week
- Python wrapper for google people-alos-ask☆107Updated last year
- Python port of Boilerpipe library☆95Updated last year
- Clean, filter and sample URLs to optimize data collection – Python & command-line – Deduplication, spam, content and language filters☆150Updated 3 weeks ago
- This repository provides usage examples for the Python module Newspaper3k.☆148Updated last year
- Target-dependent sentiment classification in news articles reporting on political events. Includes a high-quality data set of over 11k se…☆155Updated 4 months ago
- A simple module to collect video, text, and metadata from Tiktok.☆434Updated last month
- A Python scraper for the Facebook Ad Library, using the official Facebook Ad Library API.☆126Updated 6 years ago
- News crawling with StormCrawler - stores content as WARC☆359Updated 9 months ago
- A spaCy wrapper of Entity-Fishing (component) for named entity disambiguation and linking on Wikidata☆169Updated 3 years ago
- A toolkit for CDX indices such as Common Crawl and the Internet Archive's Wayback Machine☆187Updated last week
- A small command line tool and set of functions for studying coordination networks in Twitter and other social media data.☆81Updated 3 years ago
- Index Common Crawl archives in tabular format☆124Updated 2 weeks ago
- geoparsepy is a Python geoparsing library that will extract and disambiguate locations from text. It uses a local OpenStreetMap database …☆64Updated 4 years ago
- A machine learning tool for fishing entities☆265Updated 6 months ago
- Statistics of Common Crawl monthly archives mined from URL index files☆201Updated last week
- Asent is a python library for performing efficient and transparent sentiment analysis using spaCy.☆120Updated last month
- Pushshift Telegram Ingest☆86Updated 6 years ago
- Legal document classification with EuroVoc descriptors on 22 languages.☆27Updated 2 years ago
- A python based HTML to text conversion library, command line client and Web service.☆325Updated last week
- TweetNLP for all the NLP enthusiasts working on Twitter! The Python library tweetnlp provides a collection of useful tools to analyze/und…☆365Updated 7 months ago
- Process Common Crawl data with Python and Spark☆447Updated 2 weeks ago
- A collection of code, data and information related to our audit of TikTok.☆24Updated 9 months ago
- Common crawl extractor☆83Updated last year
- A spaCy wrapper of OpenTapioca for named entity linking on Wikidata☆94Updated 2 years ago
- The 4CAT Capture and Analysis Toolkit provides modular data capture & analysis for a variety of social media platforms.☆339Updated last week