Alternatives and similar repositories for trafilatura

Users that are interested in trafilatura are comparing it to the libraries listed below

• Unstructured-IO / unstructured
  Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean…
  ☆12,796Updated this week
• Filimoa / open-parse
  Improved file parsing for LLM’s
  ☆3,096Updated 10 months ago
• matthewwithanm / python-markdownify
  Convert HTML to Markdown
  ☆1,809Updated last month
• deepdoctection / deepdoctection
  A Repo For Document AI
  ☆2,965Updated 2 weeks ago
• AnswerDotAI / RAGatouille
  Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-…
  ☆3,690Updated 4 months ago
• Alir3z4 / html2text
  Convert HTML to Markdown-formatted text.
  ☆2,062Updated 5 months ago
• buriy / python-readability
  fast python port of arc90's readability tool, updated to match latest readability.js!
  ☆2,847Updated 4 months ago
• pemistahl / lingua-py
  The most accurate natural language detection library for Python, suitable for short text and mixed-language text
  ☆1,512Updated 3 months ago
• qdrant / fastembed
  Fast, Accurate, Lightweight Python library to make State of the Art Embedding
  ☆2,413Updated last month
• neuml / txtai
  💡 All-in-one open-source AI framework for semantic search, LLM orchestration and language model workflows
  ☆11,662Updated 2 weeks ago
• scrapinghub / article-extraction-benchmark
  Article extraction benchmark: dataset and evaluation scripts
  ☆329Updated last week
• miso-belica / jusText
  Heuristic based boilerplate removal tool
  ☆798Updated 7 months ago
• nlmatics / llmsherpa
  Developer APIs to Accelerate LLM Projects
  ☆1,724Updated 11 months ago
• apify / crawlee-python
  Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Dow…
  ☆6,532Updated this week
• explosion / spacy-llm
  🦙 Integrating LLMs into structured NLP pipelines
  ☆1,320Updated 8 months ago
• eyurtsev / kor
  LLM(😽)
  ☆1,688Updated 7 months ago
• eth-sri / lmql
  A language for constraint-guided and efficient LLM programming.
  ☆4,058Updated 4 months ago
• deanmalmgren / textract
  extract text from any document. no muss. no fuss.
  ☆4,315Updated 10 months ago
• dottxt-ai / outlines
  Structured Outputs
  ☆12,620Updated last week
• argilla-io / argilla
  Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets
  ☆4,711Updated last week
• deedy5 / ddgs
  DDGS | Dux Distributed Global Search. A metasearch library that aggregates results from diverse web search services
  ☆1,826Updated this week
• guardrails-ai / guardrails
  Adding guardrails to large language models.
  ☆5,720Updated last week
• explodinggradients / ragas
  Supercharge Your LLM Application Evaluations 🚀
  ☆10,905Updated this week
• alan-turing-institute / ReadabiliPy
  A simple HTML content extractor in Python. Can be run as a wrapper for Mozilla's Readability.js package or in pure-python mode.
  ☆342Updated 10 months ago
• dleemiller / WordLlama
  Things you can do with the token embeddings of an LLM
  ☆1,448Updated 6 months ago
• microsoft / LLMLingua
  [EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which ach…
  ☆5,458Updated 6 months ago
• michaelfeil / infinity
  Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali
  ☆2,474Updated 3 weeks ago
• circlemind-ai / fast-graphrag
  RAG that intelligently adapts to your use case, data, and queries
  ☆3,535Updated 3 months ago
• nlmatics / nlm-ingestor
  This repo provides the server side code for llmsherpa API to connect. It includes parsers for various file formats.
  ☆1,269Updated 6 months ago
• xhluca / bm25s
  Fast lexical search implementing BM25 in Python using Numpy, Numba and Scipy
  ☆1,335Updated 3 weeks ago