Alternatives and similar repositories for newspaper4k

Users that are interested in newspaper4k are comparing it to the libraries listed below

• johnbumgarner / newspaper3_usage_overview
  This repository provides usage examples for the Python module Newspaper3k.
  ☆149Updated 2 years ago
• SSujitX / google-news-url-decoder
  A Python script to decode Google News article URLs.
  ☆248Updated 8 months ago
• scrapinghub / article-extraction-benchmark
  Article extraction benchmark: dataset and evaluation scripts
  ☆345Updated 3 months ago
• currentslab / extractnet
  A fork of Dragnet that also extract author, headline, date, keywords from context, as well as built in metadata extraction all in one pac…
  ☆297Updated 7 months ago
• alan-turing-institute / ReadabiliPy
  A simple HTML content extractor in Python. Can be run as a wrapper for Mozilla's Readability.js package or in pure-python mode.
  ☆350Updated last year
• jpjacobpadilla / Stealth-Requests
  Undetected web-scraping & seamless HTML parsing in Python!
  ☆334Updated 5 months ago
• adbar / courlan
  Clean, filter and sample URLs to optimize data collection – Python & command-line – Deduplication, spam, content and language filters
  ☆156Updated 3 weeks ago
• raznem / parsera
  Lightweight library for scraping web-sites with LLMs
  ☆1,252Updated 3 weeks ago
• Iceloof / GoogleNews
  Script for GoogleNews
  ☆375Updated last year
• GateNLP / ultimate-sitemap-parser
  Ultimate Website Sitemap Parser
  ☆238Updated 3 weeks ago
• goose3 / goose3
  A Python 3 compatible version of goose http://goose3.readthedocs.io/en/latest/index.html
  ☆897Updated last month
• weblyzard / inscriptis
  A python based HTML to text conversion library, command line client and Web service.
  ☆331Updated last month
• daijro / hrequests
  🚀 Web scraping for humans
  ☆978Updated last year
• flairNLP / fundus
  A very simple news crawler with a funny name
  ☆427Updated 3 weeks ago
• adbar / htmldate
  Fast and robust date extraction from web pages, with Python or on the command-line
  ☆142Updated 2 months ago
• adbar / trafilatura
  Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XM…
  ☆5,151Updated 3 months ago
• sachin-sankar / swiftshadow
  Free IP Proxy rotator library for python
  ☆307Updated last month
• Nv7-GitHub / googlesearch
  A Python library for scraping the Google search engine.
  ☆768Updated 11 months ago
• karust / openserp
  Get [Google, Yandex, Baidu, Bing, DuckDuckGo] search results via API for free 🎉
  ☆573Updated 3 months ago
• AtuboDad / playwright_stealth
  playwright stealth
  ☆855Updated last year
• amerkurev / scrapper
  Web scraper with a simple REST API living in Docker and using a Headless browser and Readability.js for parsing.
  ☆297Updated 8 months ago
• scrapfly / scrapfly-scrapers
  Scalable Python web scraping scripts for +40 popular domains
  ☆821Updated this week
• EZ-hwh / AutoScraper
  Official implement of paper "AutoScraper: A Progressive Understanding Web Agent for Web Scraper Generation" [EMNLP 24']
  ☆484Updated last year
• clemlesne / scrape-it-now
  Web scraper made for AI and simplicity in mind. It runs as a CLI that can be parallelized and outputs high-quality markdown content.
  ☆540Updated 2 months ago
• scrapy-plugins / scrapy-playwright
  🎭 Playwright integration for Scrapy
  ☆1,341Updated 3 weeks ago
• kayvane1 / brave-api
  Search for words, documents, images, videos, news and maps using the Brave search engine. Downloading files and images to a local hard dr…
  ☆78Updated 6 months ago
• deedy5 / ddgs
  DDGS | Dux Distributed Global Search. A metasearch library that aggregates results from diverse web search services
  ☆2,061Updated 3 weeks ago
• explosion / spacy-layout
  📚 Process PDFs, Word documents and more with spaCy
  ☆834Updated 10 months ago
• Nykakin / chompjs
  Parsing JavaScript objects into Python data structures
  ☆217Updated 5 months ago
• jmriebold / BoilerPy3
  Python port of Boilerpipe library
  ☆96Updated last year