Alternatives and similar repositories for trafilatura

Users that are interested in trafilatura are comparing it to the libraries listed below

• AndyTheFactory / newspaper4k
  📰 Newspaper4k a fork of the beloved Newspaper3k. Extraction of articles, titles, and metadata from news websites.
  ☆905Updated 7 months ago
• explosion / spacy-llm
  🦙 Integrating LLMs into structured NLP pipelines
  ☆1,324Updated 9 months ago
• Unstructured-IO / unstructured
  Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean…
  ☆12,980Updated last week
• eyurtsev / kor
  LLM(😽)
  ☆1,684Updated 8 months ago
• buriy / python-readability
  fast python port of arc90's readability tool, updated to match latest readability.js!
  ☆2,849Updated 5 months ago
• huggingface / setfit
  Efficient few-shot learning with Sentence Transformers
  ☆2,579Updated 2 months ago
• Filimoa / open-parse
  Improved file parsing for LLM’s
  ☆3,112Updated 11 months ago
• matthewwithanm / python-markdownify
  Convert HTML to Markdown
  ☆1,823Updated 2 months ago
• 1rgs / jsonformer
  A Bulletproof Way to Generate Structured JSON from Language Models
  ☆4,840Updated last year
• eth-sri / lmql
  A language for constraint-guided and efficient LLM programming.
  ☆4,069Updated 5 months ago
• urchade / GLiNER
  Generalist and Lightweight Model for Named Entity Recognition (Extract any entity types from texts) @ NAACL 2024
  ☆2,418Updated 2 weeks ago
• goose3 / goose3
  A Python 3 compatible version of goose http://goose3.readthedocs.io/en/latest/index.html
  ☆890Updated last month
• qdrant / fastembed
  Fast, Accurate, Lightweight Python library to make State of the Art Embedding
  ☆2,446Updated this week
• pemistahl / lingua-py
  The most accurate natural language detection library for Python, suitable for short text and mixed-language text
  ☆1,523Updated this week
• Alir3z4 / html2text
  Convert HTML to Markdown-formatted text.
  ☆2,070Updated 6 months ago
• deedy5 / ddgs
  DDGS | Dux Distributed Global Search. A metasearch library that aggregates results from diverse web search services
  ☆1,863Updated last week
• deepdoctection / deepdoctection
  A Repo For Document AI
  ☆2,980Updated this week
• nlmatics / llmsherpa
  Developer APIs to Accelerate LLM Projects
  ☆1,727Updated last year
• xlang-ai / instructor-embedding
  [ACL 2023] One Embedder, Any Task: Instruction-Finetuned Text Embeddings
  ☆2,015Updated 9 months ago
• AnswerDotAI / RAGatouille
  Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-…
  ☆3,713Updated 5 months ago
• alan-turing-institute / ReadabiliPy
  A simple HTML content extractor in Python. Can be run as a wrapper for Mozilla's Readability.js package or in pure-python mode.
  ☆344Updated 10 months ago
• minimaxir / simpleaichat
  Python package for easily interfacing with chat apps, with robust features and minimal code complexity.
  ☆3,519Updated last year
• nlmatics / nlm-ingestor
  This repo provides the server side code for llmsherpa API to connect. It includes parsers for various file formats.
  ☆1,271Updated 6 months ago
• michaelfeil / infinity
  Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali
  ☆2,513Updated 2 weeks ago
• miso-belica / jusText
  Heuristic based boilerplate removal tool
  ☆800Updated 7 months ago
• deanmalmgren / textract
  extract text from any document. no muss. no fuss.
  ☆4,338Updated 10 months ago
• AgentOps-AI / tokencost
  Easy token price estimates for 400+ LLMs. TokenOps.
  ☆1,827Updated last month
• guardrails-ai / guardrails
  Adding guardrails to large language models.
  ☆5,817Updated last week
• noamgat / lm-format-enforcer
  Enforce the output format (JSON Schema, Regex etc) of a language model
  ☆1,943Updated last month
• argilla-io / argilla
  Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets
  ☆4,721Updated last week