mediacloud / metadata-libLinks
How Media Cloud approaches extracting metadata from online news stories
☆16Updated last year
Alternatives and similar repositories for metadata-lib
Users that are interested in metadata-lib are comparing it to the libraries listed below
Sorting:
- Fast and robust date extraction from web pages, with Python or on the command-line☆145Updated 3 months ago
- Ultimate Website Sitemap Parser☆242Updated 2 weeks ago
- Article extraction benchmark: dataset and evaluation scripts☆351Updated 4 months ago
- Target-dependent sentiment classification in news articles reporting on political events. Includes a high-quality data set of over 11k se…☆156Updated 6 months ago
- Clean, filter and sample URLs to optimize data collection – Python & command-line – Deduplication, spam, content and language filters☆158Updated last month
- This repository provides usage examples for the Python module Newspaper3k.☆151Updated 2 years ago
- Python port of Boilerpipe library☆96Updated last year
- A simple module to collect video, text, and metadata from Tiktok.☆442Updated 4 months ago
- A small command line tool and set of functions for studying coordination networks in Twitter and other social media data.☆82Updated 3 years ago
- A webmining CLI tool & library for python.☆352Updated this week
- Python wrapper for google people-alos-ask☆108Updated last year
- A spaCy wrapper of Entity-Fishing (component) for named entity disambiguation and linking on Wikidata☆170Updated 3 years ago
- News crawling with StormCrawler - stores content as WARC☆363Updated 11 months ago
- A Python scraper for the Facebook Ad Library, using the official Facebook Ad Library API.☆129Updated 6 years ago
- TweetNLP for all the NLP enthusiasts working on Twitter! The Python library tweetnlp provides a collection of useful tools to analyze/und…☆376Updated 10 months ago
- Die Datenbank öffentlicher Sprecher des HBI☆11Updated 10 months ago
- A python based HTML to text conversion library, command line client and Web service.☆334Updated 2 months ago
- A fork of Dragnet that also extract author, headline, date, keywords from context, as well as built in metadata extraction all in one pac…☆298Updated 8 months ago
- A web scraper for TikTok using Playwright☆130Updated this week
- A Flexible Deep Learning Approach to Fuzzy String Matching☆150Updated last year
- Example scripts for the pushshift dump files☆467Updated 3 months ago
- The 4CAT Capture and Analysis Toolkit provides modular data capture & analysis for a variety of social media platforms.☆356Updated this week
- A browser extension to collect social media data with.☆316Updated this week
- Asent is a python library for performing efficient and transparent sentiment analysis using spaCy.☆120Updated 3 months ago
- Index Common Crawl archives in tabular format☆125Updated last month
- ☆24Updated 5 years ago
- Pushshift Telegram Ingest☆85Updated 6 years ago
- A toolkit for CDX indices such as Common Crawl and the Internet Archive's Wayback Machine☆198Updated 2 weeks ago
- An EUR-Lex parser for Python.☆32Updated last year
- geoparsepy is a Python geoparsing library that will extract and disambiguate locations from text. It uses a local OpenStreetMap database …☆64Updated 4 years ago