Alternatives and similar repositories for trafilatura

Users that are interested in trafilatura are comparing it to the libraries listed below

• buriy / python-readability
  fast python port of arc90's readability tool, updated to match latest readability.js!
  ☆2,803Updated last month
• 1rgs / jsonformer
  A Bulletproof Way to Generate Structured JSON from Language Models
  ☆4,750Updated last year
• goose3 / goose3
  A Python 3 compatible version of goose http://goose3.readthedocs.io/en/latest/index.html
  ☆869Updated 5 months ago
• eth-sri / lmql
  A language for constraint-guided and efficient LLM programming.
  ☆3,968Updated last month
• dottxt-ai / outlines
  Structured Text Generation
  ☆11,843Updated this week
• pemistahl / lingua-py
  The most accurate natural language detection library for Python, suitable for short text and mixed-language text
  ☆1,399Updated last week
• scrapinghub / article-extraction-benchmark
  Article extraction benchmark: dataset and evaluation scripts
  ☆317Updated last year
• AndyTheFactory / newspaper4k
  📰 Newspaper4k a fork of the beloved Newspaper3k. Extraction of articles, titles, and metadata from news websites.
  ☆794Updated 3 months ago
• nlmatics / nlm-ingestor
  This repo provides the server side code for llmsherpa API to connect. It includes parsers for various file formats.
  ☆1,246Updated 2 months ago
• miso-belica / jusText
  Heuristic based boilerplate removal tool
  ☆783Updated 3 months ago
• Filimoa / open-parse
  Improved file parsing for LLM’s
  ☆3,002Updated 7 months ago
• qdrant / fastembed
  Fast, Accurate, Lightweight Python library to make State of the Art Embedding
  ☆2,148Updated this week
• huggingface / distil-whisper
  Distilled variant of Whisper for speech recognition. 6x faster, 50% smaller, within 1% word error rate.
  ☆3,887Updated 5 months ago
• jamesturk / scrapeghost
  👻 Experimental library for scraping websites using OpenAI's GPT API.
  ☆1,436Updated 8 months ago
• eyurtsev / kor
  LLM(😽)
  ☆1,675Updated 4 months ago
• michaelfeil / infinity
  Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali
  ☆2,252Updated 2 weeks ago
• confident-ai / deepeval
  The LLM Evaluation Framework
  ☆8,370Updated this week
• xhluca / bm25s
  Fast lexical search implementing BM25 in Python using Numpy, Numba and Scipy
  ☆1,211Updated 2 weeks ago
• nlmatics / llmsherpa
  Developer APIs to Accelerate LLM Projects
  ☆1,679Updated 8 months ago
• 567-labs / instructor
  structured outputs for llms
  ☆10,793Updated this week
• huggingface / text-embeddings-inference
  A blazing fast inference solution for text embeddings models
  ☆3,696Updated this week
• imaurer / awesome-llm-json
  Resource list for generating JSON using LLMs via function calling, tools, CFG. Libraries, Models, Notebooks, etc.
  ☆2,110Updated 4 months ago
• matthewwithanm / python-markdownify
  Convert HTML to Markdown
  ☆1,663Updated last week
• mistralai / mistral-finetune
  ☆2,965Updated 9 months ago
• AnswerDotAI / RAGatouille
  Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-…
  ☆3,496Updated last month
• Alir3z4 / html2text
  Convert HTML to Markdown-formatted text.
  ☆2,004Updated 2 months ago
• alan-turing-institute / ReadabiliPy
  A simple HTML content extractor in Python. Can be run as a wrapper for Mozilla's Readability.js package or in pure-python mode.
  ☆324Updated 6 months ago
• abetlen / llama-cpp-python
  Python bindings for llama.cpp
  ☆9,257Updated last month
• promptfoo / promptfoo
  Test your prompts, agents, and RAGs. Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude, Ge…
  ☆7,222Updated this week
• rushter / selectolax
  Python binding to Modest and Lexbor engines (fast HTML5 parser with CSS selectors).
  ☆1,284Updated this week