news-please - an integrated web crawler and information extractor for news that just works
☆2,490Apr 14, 2026Updated 5 months ago
Alternatives and similar repositories for news-please
Users that are interested in news-please are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Extraction of the journalistic five W and one H questions (5W1H) from news articles: who did what, when, where, why, and how?☆534Oct 25, 2024Updated last year
- Target-dependent sentiment classification in news articles reporting on political events. Includes a high-quality data set of over 11k se…☆157Jul 18, 2025Updated last year
- News crawling with StormCrawler - stores content as WARC☆376Updated this week
- A Python Package which helps to scrape all news details from any news websites☆230Aug 13, 2026Updated last month
- Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XM…☆6,847Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A very simple news crawler with a funny name☆476Sep 15, 2026Updated last week
- 📰 Newspaper4k a fork of the beloved Newspaper3k. Extraction of articles, titles, and metadata from news websites.☆1,139Aug 24, 2026Updated 3 weeks ago
- A News Article Collection Library☆22Mar 31, 2023Updated 3 years ago
- fast python port of arc90's readability tool, updated to match latest readability.js!☆2,894Aug 27, 2026Updated 3 weeks ago
- Lightweight scraper for Google News☆379Aug 20, 2026Updated last month
- If Google News had a Python library☆1,393Dec 9, 2024Updated last year
- A very simple framework for state-of-the-art Natural Language Processing (NLP)☆14,389Oct 27, 2025Updated 10 months ago
- Just the facts -- web page content extraction☆1,275Jul 8, 2025Updated last year
- Advanced news feeds extractor and finder library. Helps to automatically extract news from websites without RSS/ATOM feeds☆87Sep 13, 2026Updated last week
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Heuristic based boilerplate removal tool☆825Aug 18, 2026Updated last month
- A toolkit for CDX indices such as Common Crawl and the Internet Archive's Wayback Machine☆216Sep 7, 2026Updated 2 weeks ago
- Programmatically collect normalized news from (almost) any website.☆2,989Oct 30, 2020Updated 5 years ago
- A Happy and lightweight Python Package that Provides an API to search for articles on Google News and returns a JSON response.☆1,010Updated this week
- A Python 3 compatible version of goose http://goose3.readthedocs.io/en/latest/index.html☆914Jul 23, 2026Updated 2 months ago
- This repository provides usage examples for the Python module Newspaper3k.☆151Jan 2, 2024Updated 2 years ago
- A classifier that distinguishes political from non-political news articles.☆31Jul 30, 2023Updated 3 years ago
- A news crawler for BBC News, Reuters and New York Times.☆131Dec 8, 2022Updated 3 years ago
- 🧹 Python package for text cleaning☆1,031May 15, 2026Updated 4 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Matrix-based News Aggregation to Explore Media Bias☆21Jun 26, 2018Updated 8 years ago
- Extraction of the five journalistic W-questions (5W) from news articles☆19May 16, 2018Updated 8 years ago
- Beautiful visualizations of how language differs among document types.☆2,343Jul 4, 2026Updated 2 months ago
- NLP, before and after spaCy☆2,241Sep 22, 2023Updated 3 years ago
- A python package to run contextualized topic modeling. CTMs combine contextualized embeddings (e.g., BERT) with topic models to get coher…☆1,272Jul 24, 2025Updated last year
- Module for automatic summarization of text documents and HTML pages.☆3,697Sep 9, 2026Updated 2 weeks ago
- An advanced Twitter scraping & OSINT tool written in Python that doesn't use Twitter's API, allowing you to scrape a user's followers, fo…☆16,399Feb 23, 2023Updated 3 years ago
- Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and a…☆26,578Updated this week
- PYthon Automated Term Extraction☆318Feb 8, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Python implementation of TextRank algorithms ("textgraphs") for phrase extraction☆2,219Jun 24, 2026Updated 2 months ago
- News API - fetch news from CommonCrawl, parse with NewsPlease, enrich with pre-trained machine-learning models, to structured searchable …☆31Oct 5, 2022Updated 3 years ago
- Extract networks of entities from journalistic reporting☆49Jul 17, 2023Updated 3 years ago
- Open source annotation tool for machine learning practitioners.☆10,772Apr 14, 2026Updated 5 months ago
- Extract embedded metadata from HTML markup☆972Apr 1, 2026Updated 5 months ago
- A fork of Dragnet that also extract author, headline, date, keywords from context, as well as built in metadata extraction all in one pac…☆300May 19, 2025Updated last year
- Fast & easy transfer learning for NLP. Harvesting language models for the industry. Focus on Question Answering.☆1,754Dec 20, 2023Updated 2 years ago