Alternatives and similar repositories for trafilatura

Users that are interested in trafilatura are comparing it to the libraries listed below

• AndyTheFactory / newspaper4k
  📰 Newspaper4k a fork of the beloved Newspaper3k. Extraction of articles, titles, and metadata from news websites.
  ☆809Updated 4 months ago
• scrapinghub / article-extraction-benchmark
  Article extraction benchmark: dataset and evaluation scripts
  ☆318Updated last year
• buriy / python-readability
  fast python port of arc90's readability tool, updated to match latest readability.js!
  ☆2,819Updated 2 months ago
• goose3 / goose3
  A Python 3 compatible version of goose http://goose3.readthedocs.io/en/latest/index.html
  ☆872Updated 6 months ago
• eyurtsev / kor
  LLM(😽)
  ☆1,682Updated 5 months ago
• lavague-ai / LaVague
  Large Action Model framework to develop AI Web Agents
  ☆6,090Updated 5 months ago
• fhamborg / news-please
  news-please - an integrated web crawler and information extractor for news that just works
  ☆2,274Updated last month
• 1rgs / jsonformer
  A Bulletproof Way to Generate Structured JSON from Language Models
  ☆4,766Updated last year
• deedy5 / ddgs
  D.D.G.S. | Dux Distributed Global Search. A metasearch library that aggregates results from diverse web search services
  ☆1,684Updated this week
• explosion / spacy-llm
  🦙 Integrating LLMs into structured NLP pipelines
  ☆1,279Updated 6 months ago
• dragnet-org / dragnet
  Just the facts -- web page content extraction
  ☆1,270Updated last week
• promptslab / Promptify
  Prompt Engineering | Prompt Versioning | Use GPT or other prompt based models to get structured output. Join our discord for Prompt-Engin…
  ☆3,979Updated 5 months ago
• apify / crawlee-python
  Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Dow…
  ☆5,835Updated this week
• pemistahl / lingua-py
  The most accurate natural language detection library for Python, suitable for short text and mixed-language text
  ☆1,420Updated last month
• eth-sri / lmql
  A language for constraint-guided and efficient LLM programming.
  ☆3,992Updated last month
• jackmpcollins / magentic
  Seamlessly integrate LLMs as Python functions
  ☆2,338Updated 3 weeks ago
• qdrant / fastembed
  Fast, Accurate, Lightweight Python library to make State of the Art Embedding
  ☆2,207Updated last week
• matthewwithanm / python-markdownify
  Convert HTML to Markdown
  ☆1,717Updated this week
• rushter / selectolax
  Python binding to Modest and Lexbor engines (fast HTML5 parser with CSS selectors).
  ☆1,353Updated 2 weeks ago
• deepdoctection / deepdoctection
  A Repo For Document AI
  ☆2,882Updated last week
• reworkd / tarsier
  Vision utilities for web interaction agents 👀
  ☆1,705Updated 7 months ago
• codelucas / newspaper
  newspaper3k is a news, full-text, and article metadata extraction in Python 3. Advanced docs:
  ☆14,659Updated last week
• argilla-io / argilla
  Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets
  ☆4,577Updated last week
• urchade / GLiNER
  Generalist and Lightweight Model for Named Entity Recognition (Extract any entity types from texts) @ NAACL 2024
  ☆2,146Updated last week
• jamesturk / scrapeghost
  👻 Experimental library for scraping websites using OpenAI's GPT API.
  ☆1,440Updated last month
• Filimoa / open-parse
  Improved file parsing for LLM’s
  ☆3,016Updated 8 months ago
• dottxt-ai / outlines
  Structured Outputs
  ☆12,084Updated last week
• Alir3z4 / html2text
  Convert HTML to Markdown-formatted text.
  ☆2,025Updated 3 months ago
• miso-belica / jusText
  Heuristic based boilerplate removal tool
  ☆784Updated 4 months ago
• noamgat / lm-format-enforcer
  Enforce the output format (JSON Schema, Regex etc) of a language model
  ☆1,841Updated 4 months ago