Alternatives and similar repositories for newspaper4k

Users that are interested in newspaper4k are comparing it to the libraries listed below

• SSujitX / google-news-url-decoder
  A Python script to decode Google News article URLs.
  ☆260Updated 9 months ago
• currentslab / extractnet
  A fork of Dragnet that also extract author, headline, date, keywords from context, as well as built in metadata extraction all in one pac…
  ☆298Updated 8 months ago
• johnbumgarner / newspaper3_usage_overview
  This repository provides usage examples for the Python module Newspaper3k.
  ☆151Updated 2 years ago
• scrapinghub / article-extraction-benchmark
  Article extraction benchmark: dataset and evaluation scripts
  ☆351Updated 4 months ago
• alan-turing-institute / ReadabiliPy
  A simple HTML content extractor in Python. Can be run as a wrapper for Mozilla's Readability.js package or in pure-python mode.
  ☆352Updated last year
• adbar / trafilatura
  Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XM…
  ☆5,279Updated 4 months ago
• Nv7-GitHub / googlesearch
  A Python library for scraping the Google search engine.
  ☆771Updated last year
• fhamborg / news-please
  news-please - an integrated web crawler and information extractor for news that just works
  ☆2,382Updated 4 months ago
• adbar / courlan
  Clean, filter and sample URLs to optimize data collection – Python & command-line – Deduplication, spam, content and language filters
  ☆158Updated last month
• goose3 / goose3
  A Python 3 compatible version of goose http://goose3.readthedocs.io/en/latest/index.html
  ☆902Updated this week
• adbar / htmldate
  Fast and robust date extraction from web pages, with Python or on the command-line
  ☆145Updated 3 months ago
• flairNLP / fundus
  A very simple news crawler with a funny name
  ☆436Updated this week
• raznem / parsera
  Lightweight library for scraping web-sites with LLMs
  ☆1,266Updated last month
• weblyzard / inscriptis
  A python based HTML to text conversion library, command line client and Web service.
  ☆334Updated 2 months ago
• GateNLP / ultimate-sitemap-parser
  Ultimate Website Sitemap Parser
  ☆242Updated 2 weeks ago
• pemistahl / lingua-py
  The most accurate natural language detection library for Python, suitable for short text and mixed-language text
  ☆1,627Updated 2 months ago
• Iceloof / GoogleNews
  Script for GoogleNews
  ☆376Updated last year
• nlmatics / llmsherpa
  Developer APIs to Accelerate LLM Projects
  ☆1,742Updated last year
• explosion / spacy-layout
  📚 Process PDFs, Word documents and more with spaCy
  ☆850Updated 11 months ago
• nlmatics / nlm-ingestor
  This repo provides the server side code for llmsherpa API to connect. It includes parsers for various file formats.
  ☆1,275Updated 10 months ago
• jmriebold / BoilerPy3
  Python port of Boilerpipe library
  ☆96Updated last year
• isaacus-dev / semchunk
  A fast, lightweight and easy-to-use Python library for splitting text into semantically meaningful chunks.
  ☆560Updated 3 months ago
• amerkurev / scrapper
  Web scraper with a simple REST API living in Docker and using a Headless browser and Readability.js for parsing.
  ☆302Updated 10 months ago
• D-Star-AI / dsRAG
  High-performance retrieval engine for unstructured data
  ☆1,553Updated 3 months ago
• scrapoxy / scraping-workshop
  ☆123Updated 3 months ago
• tasos-py / Search-Engines-Scraper
  Search google, bing, yahoo, and other search engines with python
  ☆666Updated 10 months ago
• scrapinghub / extruct
  Extract embedded metadata from HTML markup
  ☆945Updated 4 months ago
• johnbalvin / pyairbnb
  Airbnb scraper made in Python
  ☆110Updated last week
• qdrant / fastembed
  Fast, Accurate, Lightweight Python library to make State of the Art Embedding
  ☆2,687Updated last month
• urchade / GLiNER
  Generalist and Lightweight Model for Named Entity Recognition (Extract any entity types from texts) @ NAACL 2024
  ☆2,774Updated last week