Alternatives and similar repositories for newspaper4k

Users that are interested in newspaper4k are comparing it to the libraries listed below

• johnbumgarner / newspaper3_usage_overview
  This repository provides usage examples for the Python module Newspaper3k.
  ☆148Updated last year
• SSujitX / google-news-url-decoder
  A Python script to decode Google News article URLs.
  ☆244Updated 7 months ago
• currentslab / extractnet
  A fork of Dragnet that also extract author, headline, date, keywords from context, as well as built in metadata extraction all in one pac…
  ☆297Updated 7 months ago
• scrapinghub / article-extraction-benchmark
  Article extraction benchmark: dataset and evaluation scripts
  ☆341Updated 2 months ago
• goose3 / goose3
  A Python 3 compatible version of goose http://goose3.readthedocs.io/en/latest/index.html
  ☆896Updated last week
• adbar / trafilatura
  Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XM…
  ☆5,060Updated 3 months ago
• alan-turing-institute / ReadabiliPy
  A simple HTML content extractor in Python. Can be run as a wrapper for Mozilla's Readability.js package or in pure-python mode.
  ☆349Updated last year
• weblyzard / inscriptis
  A python based HTML to text conversion library, command line client and Web service.
  ☆331Updated last month
• raznem / parsera
  Lightweight library for scraping web-sites with LLMs
  ☆1,249Updated 2 months ago
• Nv7-GitHub / googlesearch
  A Python library for scraping the Google search engine.
  ☆765Updated 10 months ago
• matthewwithanm / python-markdownify
  Convert HTML to Markdown
  ☆1,991Updated last month
• GateNLP / ultimate-sitemap-parser
  Ultimate Website Sitemap Parser
  ☆236Updated last week
• adbar / htmldate
  Fast and robust date extraction from web pages, with Python or on the command-line
  ☆142Updated last month
• fhamborg / news-please
  news-please - an integrated web crawler and information extractor for news that just works
  ☆2,356Updated 2 months ago
• adbar / courlan
  Clean, filter and sample URLs to optimize data collection – Python & command-line – Deduplication, spam, content and language filters
  ☆154Updated last month
• jmriebold / BoilerPy3
  Python port of Boilerpipe library
  ☆96Updated last year
• flairNLP / fundus
  A very simple news crawler with a funny name
  ☆423Updated this week
• devflowinc / firecrawl-simple
  ➖ Stripped down, stable version of firecrawl optimized for self-hosting and ease of contribution. Billing logic and AI features are compl…
  ☆624Updated 6 months ago
• buriy / python-readability
  fast python port of arc90's readability tool, updated to match latest readability.js!
  ☆2,870Updated 7 months ago
• lagranges / people_also_ask
  Python wrapper for google people-alos-ask
  ☆107Updated last year
• scrapy-plugins / scrapy-playwright
  🎭 Playwright integration for Scrapy
  ☆1,325Updated last week
• miso-belica / jusText
  Heuristic based boilerplate removal tool
  ☆810Updated 9 months ago
• kotartemiy / pygooglenews
  If Google News had a Python library
  ☆1,380Updated last year
• AgentOps-AI / tokencost
  Easy token price estimates for 400+ LLMs. TokenOps.
  ☆1,855Updated 3 months ago
• karust / openserp
  Get [Google, Yandex, Baidu, Bing, DuckDuckGo] search results via API for free 🎉
  ☆561Updated 2 months ago
• explosion / spacy-layout
  📚 Process PDFs, Word documents and more with spaCy
  ☆824Updated 9 months ago
• paulpierre / markdown-crawler
  A multithreaded 🕸️ web crawler that recursively crawls a website and creates a 🔽 markdown file for each page, designed for LLM RAG
  ☆421Updated last year
• Iceloof / GoogleNews
  Script for GoogleNews
  ☆375Updated last year
• getlinksc / css-selector-tool
  A low-code data extractor for websites with built in proxy and parsing capabilities. Great for testing and debugging css selectors
  ☆191Updated last year
• cullenwatson / StaffSpy
  Staff fetcher library for LinkedIn - obtain experiences, schools, skills & contact info
  ☆220Updated 6 months ago