Alternatives and similar repositories for trafilatura

Users that are interested in trafilatura are comparing it to the libraries listed below

• Filimoa / open-parse
  Improved file parsing for LLM’s
  ☆3,137Updated last year
• AndyTheFactory / newspaper4k
  📰 Newspaper4k a fork of the beloved Newspaper3k. Extraction of articles, titles, and metadata from news websites.
  ☆934Updated last week
• matthewwithanm / python-markdownify
  Convert HTML to Markdown
  ☆1,872Updated 2 weeks ago
• michaelfeil / infinity
  Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali
  ☆2,562Updated last week
• qdrant / fastembed
  Fast, Accurate, Lightweight Python library to make State of the Art Embedding
  ☆2,524Updated last week
• Unstructured-IO / unstructured
  Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean…
  ☆13,304Updated last week
• explosion / spacy-llm
  🦙 Integrating LLMs into structured NLP pipelines
  ☆1,351Updated 10 months ago
• nlmatics / llmsherpa
  Developer APIs to Accelerate LLM Projects
  ☆1,741Updated last year
• deedy5 / ddgs
  DDGS | Dux Distributed Global Search. A metasearch library that aggregates results from diverse web search services
  ☆1,975Updated this week
• AnswerDotAI / RAGatouille
  Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-…
  ☆3,778Updated 6 months ago
• buriy / python-readability
  fast python port of arc90's readability tool, updated to match latest readability.js!
  ☆2,862Updated 7 months ago
• neuml / txtai
  💡 All-in-one open-source AI framework for semantic search, LLM orchestration and language model workflows
  ☆11,861Updated last week
• Dicklesworthstone / llm_aided_ocr
  Enhance Tesseract OCR output for scanned PDFs by applying Large Language Model (LLM) corrections.
  ☆2,783Updated 9 months ago
• eyurtsev / kor
  LLM(😽)
  ☆1,692Updated 10 months ago
• scrapinghub / article-extraction-benchmark
  Article extraction benchmark: dataset and evaluation scripts
  ☆340Updated 2 months ago
• deepdoctection / deepdoctection
  A Repo For Document AI
  ☆3,086Updated this week
• rushter / selectolax
  Python binding to Modest and Lexbor engines. Fast HTML5 parser with CSS selectors for Python.
  ☆1,477Updated this week
• jamesturk / scrapeghost
  👻 Experimental library for scraping websites using OpenAI's GPT API.
  ☆1,444Updated 5 months ago
• argilla-io / argilla
  Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets
  ☆4,763Updated last week
• pemistahl / lingua-py
  The most accurate natural language detection library for Python, suitable for short text and mixed-language text
  ☆1,570Updated last week
• jackmpcollins / magentic
  Seamlessly integrate LLMs as Python functions
  ☆2,385Updated last week
• aurelio-labs / semantic-router
  Superfast AI decision making and intelligent processing of multi-modal data.
  ☆2,917Updated 2 weeks ago
• run-llama / llama_cloud_services
  Knowledge Agents and Management in the Cloud
  ☆4,209Updated this week
• urchade / GLiNER
  Generalist and Lightweight Model for Named Entity Recognition (Extract any entity types from texts) @ NAACL 2024
  ☆2,550Updated last week
• xhluca / bm25s
  Fast lexical search implementing BM25 in Python using Numpy, Numba and Scipy
  ☆1,413Updated this week
• D-Star-AI / dsRAG
  High-performance retrieval engine for unstructured data
  ☆1,533Updated 3 weeks ago
• huggingface / text-embeddings-inference
  A blazing fast inference solution for text embeddings models
  ☆4,252Updated 2 weeks ago
• noamgat / lm-format-enforcer
  Enforce the output format (JSON Schema, Regex etc) of a language model
  ☆1,960Updated 3 months ago
• dottxt-ai / outlines
  Structured Outputs
  ☆12,984Updated last week
• 567-labs / instructor
  structured outputs for llms
  ☆11,897Updated this week