alan-turing-institute / ReadabiliPy
A simple HTML content extractor in Python. Can be run as a wrapper for Mozilla's Readability.js package or in pure-python mode.
☆260Updated 2 months ago
Alternatives and similar repositories for ReadabiliPy:
Users that are interested in ReadabiliPy are comparing it to the libraries listed below
- A python based HTML to text conversion library, command line client and Web service.☆285Updated last month
- Clean, filter and sample URLs to optimize data collection – Python & command-line – Deduplication, spam, content and language filters☆133Updated last month
- Python port of Boilerpipe library☆86Updated 5 months ago
- Article extraction benchmark: dataset and evaluation scripts☆300Updated 9 months ago
- Fast and robust date extraction from web pages, with Python or on the command-line☆122Updated last month
- A fork of Dragnet that also extract author, headline, date, keywords from context, as well as built in metadata extraction all in one pac…☆263Updated last year
- hnsqlite integrates hnswlib and sqlite for simple text embedding search☆157Updated last year
- 🖍️ Highlight text in documents☆99Updated last month
- 80x faster and 95% accurate language identification with Fasttext☆146Updated last year
- Full text search in your Pandas dataframe☆216Updated 2 months ago
- 📰 Newspaper4k a fork of the beloved Newspaper3k. Extraction of articles, titles, and metadata from news websites.☆620Updated 8 months ago
- This repository provides usage examples for the Python module Newspaper3k.☆146Updated last year
- Extract text from HTML☆133Updated 4 years ago
- A Python 3 compatible version of goose http://goose3.readthedocs.io/en/latest/index.html☆851Updated last month
- fast python port of arc90's readability tool, updated to match latest readability.js!☆2,722Updated last month
- Ultimate Website Sitemap Parser☆191Updated 2 weeks ago
- Parse numbers written in natural language☆109Updated 3 months ago
- Information extraction from English and German texts based on predicate logic☆135Updated last year
- Structured and typehinted GPT responses in Python☆735Updated 6 months ago
- ✨ Bootstrap annotation with zero- & few-shot learning via OpenAI GPT-3☆322Updated last year
- Add website scraping abilities to Datasette☆62Updated last year
- Python bindings for Tantivy☆309Updated this week
- Python3 bindings for the Compact Language Detector v3 (CLD3)☆149Updated last year
- 💭 Retrieval augmented generation (RAG) and language model powered search applications☆287Updated last month
- Simple multilingual lemmatizer for Python, especially useful for speed and efficiency☆151Updated 2 months ago
- Labelling platform for text using weak supervision.☆260Updated 2 years ago
- Python API for https://vespa.ai, the open big data serving engine☆113Updated this week
- LLM plugin providing access to Mistral models using the Mistral API☆167Updated 2 weeks ago
- Repair invalid LLM JSON, commonly used to parse the output of LLMs — Parsing ChatGPT and llm JSON stream response — Partial and incomplet…☆69Updated 3 weeks ago
- Boilerplate Removal using Deep Learning☆81Updated 3 years ago