Alternatives and similar repositories for trafilatura

Users that are interested in trafilatura are comparing it to the libraries listed below

• AndyTheFactory / newspaper4k
  📰 Newspaper4k a fork of the beloved Newspaper3k. Extraction of articles, titles, and metadata from news websites.
  ☆830Updated 4 months ago
• dottxt-ai / outlines
  Structured Outputs
  ☆12,188Updated this week
• buriy / python-readability
  fast python port of arc90's readability tool, updated to match latest readability.js!
  ☆2,826Updated 2 months ago
• 1rgs / jsonformer
  A Bulletproof Way to Generate Structured JSON from Language Models
  ☆4,777Updated last year
• urchade / GLiNER
  Generalist and Lightweight Model for Named Entity Recognition (Extract any entity types from texts) @ NAACL 2024
  ☆2,196Updated this week
• Unstructured-IO / unstructured
  Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean…
  ☆12,035Updated last week
• explosion / spacy-llm
  🦙 Integrating LLMs into structured NLP pipelines
  ☆1,289Updated 6 months ago
• pemistahl / lingua-py
  The most accurate natural language detection library for Python, suitable for short text and mixed-language text
  ☆1,443Updated last month
• qdrant / fastembed
  Fast, Accurate, Lightweight Python library to make State of the Art Embedding
  ☆2,253Updated last week
• michaelfeil / infinity
  Infinity is a high-throughput, low-latency serving engine for text-embeddings, reranking models, clip, clap and colpali
  ☆2,331Updated last week
• AnswerDotAI / RAGatouille
  Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-…
  ☆3,603Updated 2 months ago
• scrapinghub / article-extraction-benchmark
  Article extraction benchmark: dataset and evaluation scripts
  ☆320Updated last year
• Filimoa / open-parse
  Improved file parsing for LLM’s
  ☆3,034Updated 8 months ago
• matthewwithanm / python-markdownify
  Convert HTML to Markdown
  ☆1,729Updated 2 weeks ago
• neuml / txtai
  💡 All-in-one open-source AI framework for semantic search, LLM orchestration and language model workflows
  ☆11,323Updated 2 weeks ago
• eth-sri / lmql
  A language for constraint-guided and efficient LLM programming.
  ☆4,018Updated 2 months ago
• jackmpcollins / magentic
  Seamlessly integrate LLMs as Python functions
  ☆2,348Updated last month
• noamgat / lm-format-enforcer
  Enforce the output format (JSON Schema, Regex etc) of a language model
  ☆1,861Updated 5 months ago
• miso-belica / jusText
  Heuristic based boilerplate removal tool
  ☆786Updated 5 months ago
• goose3 / goose3
  A Python 3 compatible version of goose http://goose3.readthedocs.io/en/latest/index.html
  ☆876Updated 7 months ago
• 567-labs / instructor
  structured outputs for llms
  ☆11,098Updated this week
• eyurtsev / kor
  LLM(😽)
  ☆1,682Updated 5 months ago
• Alir3z4 / html2text
  Convert HTML to Markdown-formatted text.
  ☆2,025Updated 3 months ago
• argilla-io / argilla
  Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets
  ☆4,613Updated this week
• microsoft / LLMLingua
  [EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which ach…
  ☆5,300Updated 4 months ago
• MaartenGr / KeyBERT
  Minimal keyword extraction with BERT
  ☆3,951Updated 3 weeks ago
• jamesturk / scrapeghost
  👻 Experimental library for scraping websites using OpenAI's GPT API.
  ☆1,442Updated last month
• AnswerDotAI / rerankers
  A lightweight, low-dependency, unified API to use all common reranking and cross-encoder models.
  ☆1,505Updated 2 months ago
• deedy5 / ddgs
  DDGS | Dux Distributed Global Search. A metasearch library that aggregates results from diverse web search services
  ☆1,702Updated this week
• dleemiller / WordLlama
  Things you can do with the token embeddings of an LLM
  ☆1,445Updated 4 months ago