alan-turing-institute / ReadabiliPyLinks
A simple HTML content extractor in Python. Can be run as a wrapper for Mozilla's Readability.js package or in pure-python mode.
☆346Updated 11 months ago
Alternatives and similar repositories for ReadabiliPy
Users that are interested in ReadabiliPy are comparing it to the libraries listed below
Sorting:
- A python based HTML to text conversion library, command line client and Web service.☆323Updated 3 weeks ago
- Clean, filter and sample URLs to optimize data collection – Python & command-line – Deduplication, spam, content and language filters☆150Updated 2 weeks ago
- Article extraction benchmark: dataset and evaluation scripts☆337Updated last month
- Fast and robust date extraction from web pages, with Python or on the command-line☆142Updated last week
- Python port of Boilerpipe library☆93Updated last year
- A fork of Dragnet that also extract author, headline, date, keywords from context, as well as built in metadata extraction all in one pac…☆295Updated 5 months ago
- Heuristic based boilerplate removal tool☆804Updated 8 months ago
- Full text search that feels like a numpy array☆264Updated last month
- A Python 3 compatible version of goose http://goose3.readthedocs.io/en/latest/index.html☆893Updated 2 weeks ago
- hnsqlite integrates hnswlib and sqlite for simple text embedding search☆161Updated 2 years ago
- 📰 Newspaper4k a fork of the beloved Newspaper3k. Extraction of articles, titles, and metadata from news websites.☆915Updated this week
- A pythonic library providing light-weighted interface with LLMs☆129Updated 5 months ago
- Easy-to-Use Apple Vision wrapper for text extraction, scalar representation and clustering using K-means.☆112Updated last year
- Show the differences between two strings/text as a compact text, in markdown/HTML, in the terminal and more.☆147Updated last week
- Whoosh is a fast, featureful full-text indexing and searching library implemented in pure Python.☆225Updated this week
- 🏭 PDF text extraction pipeline: self-hosted, local-first, Docker-based☆329Updated 2 years ago
- Python JSON parser for reading JSON objects out of JS files☆47Updated 2 years ago
- 🖍️ Highlight text in documents☆109Updated 6 months ago
- 80x faster and 95% accurate language identification with Fasttext☆161Updated last year
- ⚡️ 80x faster Fasttext language detection out of the box | Split text by language☆255Updated last month
- 📄 ⚙️ ETL processes for medical and scientific papers☆400Updated 3 months ago
- Pure-Python full-text search library☆646Updated last year
- Python bindings for Tantivy☆369Updated this week
- Python3 bindings for the Compact Language Detector v3 (CLD3)☆154Updated 2 years ago
- A fast, lightweight and easy-to-use Python library for splitting text into semantically meaningful chunks.☆418Updated 2 weeks ago
- 90% of what you need for LLM app development. Nothing you don't.☆263Updated 2 months ago
- python library to simplify working with jsonlines and ndjson data☆304Updated last year
- Find the Python code for specified symbols☆308Updated 6 months ago
- Streaming WARC/ARC library for fast web archive IO☆438Updated 11 months ago
- Parse numbers written in natural language☆123Updated last year