alan-turing-institute / ReadabiliPy
A simple HTML content extractor in Python. Can be run as a wrapper for Mozilla's Readability.js package or in pure-python mode.
☆303Updated 5 months ago
Alternatives and similar repositories for ReadabiliPy:
Users that are interested in ReadabiliPy are comparing it to the libraries listed below
- Article extraction benchmark: dataset and evaluation scripts☆315Updated last year
- Clean, filter and sample URLs to optimize data collection – Python & command-line – Deduplication, spam, content and language filters☆137Updated 4 months ago
- A python based HTML to text conversion library, command line client and Web service.☆303Updated last month
- Python port of Boilerpipe library☆87Updated 8 months ago
- Fast and robust date extraction from web pages, with Python or on the command-line☆126Updated 4 months ago
- A fork of Dragnet that also extract author, headline, date, keywords from context, as well as built in metadata extraction all in one pac…☆276Updated last year
- 📰 Newspaper4k a fork of the beloved Newspaper3k. Extraction of articles, titles, and metadata from news websites.☆752Updated last month
- Full text search that feels like a numpy array☆236Updated 2 weeks ago
- Boilerplate Removal using Deep Learning☆82Updated 3 years ago
- Parse numbers written in natural language☆114Updated 6 months ago
- This repository provides usage examples for the Python module Newspaper3k.☆147Updated last year
- hnsqlite integrates hnswlib and sqlite for simple text embedding search☆159Updated last year
- fast python port of arc90's readability tool, updated to match latest readability.js!☆2,768Updated this week
- 80x faster and 95% accurate language identification with Fasttext☆153Updated last year
- Python bindings for Tantivy☆329Updated last week
- Extract text from HTML☆135Updated 4 years ago
- A fast, lightweight and easy-to-use Python library for splitting text into semantically meaningful chunks.☆299Updated last month
- Repair invalid LLM JSON, commonly used to parse the output of LLMs — Parsing ChatGPT and llm JSON stream response — Partial and incomplet…☆79Updated 3 months ago
- Search for words, documents, images, videos, news and maps using the Brave search engine. Downloading files and images to a local hard dr…☆60Updated last year
- Measure the readability of a given text using surface characteristics☆79Updated 3 months ago
- Text to sentence splitter using heuristic algorithm by Philipp Koehn and Josh Schroeder.☆245Updated 2 years ago
- Python3 bindings for the Compact Language Detector v3 (CLD3)☆151Updated last year
- Parsing JavaScript objects into Python data structures☆203Updated this week
- Extract price amount and currency symbol from a raw text string☆327Updated 2 months ago
- CLI tool for stripping tags from HTML☆317Updated 2 months ago
- Show the differences between two strings/text as a compact text, in markdown/HTML, in the terminal and more.☆128Updated 6 months ago
- Python API for https://vespa.ai, the open big data serving engine☆122Updated this week
- Convert HTML to Markdown☆1,585Updated this week
- Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XM…☆4,205Updated last month
- A Python feed reader library.☆485Updated this week