Alternatives and similar repositories for trafilatura

Users that are interested in trafilatura are comparing it to the libraries listed below

• AndyTheFactory / newspaper4k
  📰 Newspaper4k a fork of the beloved Newspaper3k. Extraction of articles, titles, and metadata from news websites.
  ☆913Updated last week
• deepdoctection / deepdoctection
  A Repo For Document AI
  ☆3,033Updated this week
• Filimoa / open-parse
  Improved file parsing for LLM’s
  ☆3,129Updated last year
• rapidfuzz / RapidFuzz
  Rapid fuzzy string matching in Python using various string metrics
  ☆3,508Updated last week
• fhamborg / news-please
  news-please - an integrated web crawler and information extractor for news that just works
  ☆2,344Updated last month
• matthewwithanm / python-markdownify
  Convert HTML to Markdown
  ☆1,840Updated 3 months ago
• pemistahl / lingua-py
  The most accurate natural language detection library for Python, suitable for short text and mixed-language text
  ☆1,545Updated 3 weeks ago
• scrapinghub / article-extraction-benchmark
  Article extraction benchmark: dataset and evaluation scripts
  ☆337Updated last month
• Alir3z4 / html2text
  Convert HTML to Markdown-formatted text.
  ☆2,077Updated 2 weeks ago
• xhluca / bm25s
  Fast lexical search implementing BM25 in Python using Numpy, Numba and Scipy
  ☆1,384Updated last week
• AgentOps-AI / tokencost
  Easy token price estimates for 400+ LLMs. TokenOps.
  ☆1,836Updated 2 months ago
• explosion / spacy-llm
  🦙 Integrating LLMs into structured NLP pipelines
  ☆1,342Updated 10 months ago
• AnswerDotAI / RAGatouille
  Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-…
  ☆3,755Updated 5 months ago
• michaelfeil / infinity
  Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali
  ☆2,541Updated 2 weeks ago
• eyurtsev / kor
  LLM(😽)
  ☆1,685Updated 9 months ago
• qdrant / fastembed
  Fast, Accurate, Lightweight Python library to make State of the Art Embedding
  ☆2,477Updated 2 weeks ago
• seatgeek / thefuzz
  Fuzzy String Matching in Python
  ☆3,479Updated 8 months ago
• goose3 / goose3
  A Python 3 compatible version of goose http://goose3.readthedocs.io/en/latest/index.html
  ☆893Updated 2 weeks ago
• eth-sri / lmql
  A language for constraint-guided and efficient LLM programming.
  ☆4,078Updated 5 months ago
• kermitt2 / grobid
  A machine learning software for extracting information from scholarly documents
  ☆4,431Updated this week
• huggingface / text-embeddings-inference
  A blazing fast inference solution for text embeddings models
  ☆4,177Updated last week
• 1rgs / jsonformer
  A Bulletproof Way to Generate Structured JSON from Language Models
  ☆4,847Updated last year
• segment-any-text / wtpsplit
  Toolkit to segment text into sentences or other semantic units in a robust, efficient and adaptable way.
  ☆1,190Updated last month
• neuml / txtai
  💡 All-in-one open-source AI framework for semantic search, LLM orchestration and language model workflows
  ☆11,790Updated last week
• deedy5 / ddgs
  DDGS | Dux Distributed Global Search. A metasearch library that aggregates results from diverse web search services
  ☆1,928Updated this week
• buriy / python-readability
  fast python port of arc90's readability tool, updated to match latest readability.js!
  ☆2,852Updated 6 months ago
• noamgat / lm-format-enforcer
  Enforce the output format (JSON Schema, Regex etc) of a language model
  ☆1,946Updated 2 months ago
• impira / docquery
  An easy way to extract information from documents
  ☆1,782Updated 2 years ago
• xlang-ai / instructor-embedding
  [ACL 2023] One Embedder, Any Task: Instruction-Finetuned Text Embeddings
  ☆2,015Updated 9 months ago
• rushter / selectolax
  Python binding to Modest and Lexbor engines. Fast HTML5 parser with CSS selectors for Python.
  ☆1,460Updated last month