Alternatives and similar repositories for web2text

Users that are interested in web2text are comparing it to the libraries listed below

• mrjleo / boilernet
  Boilerplate Removal using Deep Learning
  ☆82Updated 3 years ago
• scrapinghub / article-extraction-benchmark
  Article extraction benchmark: dataset and evaluation scripts
  ☆315Updated last year
• kennethkenneth / AuthorExtractor
  Source code for the Medium article "Extracting the author of news stories with DOM-based segmentation and BERT"
  ☆29Updated 5 years ago
• seomoz / dragnet_data
  Training/test data for Dragnet
  ☆41Updated 10 years ago
• scrapinghub / webstruct
  NER toolkit for HTML data
  ☆259Updated last year
• jmriebold / BoilerPy3
  Python port of Boilerpipe library
  ☆88Updated 9 months ago
• TeamHG-Memex / html-text
  Extract text from HTML
  ☆135Updated 4 years ago
• gogartom / TextMaps
  ☆91Updated 9 years ago
• miso-belica / jusText
  Heuristic based boilerplate removal tool
  ☆780Updated 3 months ago
• commoncrawl / news-crawl
  News crawling with StormCrawler - stores content as WARC
  ☆346Updated 3 months ago
• scrapinghub / python-simhash
  An efficient simhash implementation for python
  ☆125Updated 5 years ago
• scrapinghub / mdr
  A python library detect and extract listing data from HTML page.
  ☆108Updated 8 years ago
• CogComp / talen
  A way to do annotations for NER. TALEN: Tool for Annotation of Low-resource ENtities
  ☆115Updated 3 years ago
• dbpedia-spotlight / spotlight-docker
  Docker containers for DBpedia Spotlight
  ☆74Updated last year
• fnl / syntok
  Text tokenization and sentence segmentation (segtok v2)
  ☆205Updated 3 years ago
• ziyan / spider
  Web Content Extraction Through Machine Learning
  ☆185Updated 11 years ago
• falcony-io / ml-annotate
  Use ML-Annotate to label data for machine learning purposes
  ☆108Updated 4 years ago
• fnl / segtok
  Segtok v2 is here: https://github.com/fnl/syntok -- A rule-based sentence segmenter (splitter) and a word tokenizer using orthographic fe…
  ☆170Updated 3 years ago
• nickdavidhaynes / spacy-cld
  Language detection extension for spaCy 2.0+
  ☆112Updated 6 years ago
• misja / python-boilerpipe
  Python interface to Boilerpipe, Boilerplate Removal and Fulltext Extraction from HTML pages
  ☆542Updated 3 years ago
• dragnet-org / dragnet
  Just the facts -- web page content extraction
  ☆1,266Updated 11 months ago
• seomoz / simhash-py
  Simhash and near-duplicate detection
  ☆415Updated 2 years ago
• ziqizhang / jate
  NEWS: JATE2.0 Beta.11 Released, see details below.
  ☆81Updated last year
• DiceTechJobs / VectorsInSearch
  Dice.com repo to accompany the dice.com 'Vectors in Search' talk by Simon Hughes, from the Activate 2018 search conference, and the 'Sear…
  ☆85Updated 4 years ago
• scrapinghub / page_clustering
  A simple algorithm for clustering web pages, suitable for crawlers
  ☆34Updated 8 years ago
• DiceTechJobs / ConceptualSearch
  Train a Word2Vec model or LSA model, and Implement Conceptual Search\Semantic Search in Solr\Lucene - Simon Hughes Dice.com, Dice Tech Jo…
  ☆257Updated 6 years ago
• jobergum / dense-vector-ranking-performance
  Performance evaluation of nearest neighbor search using Vespa, Elasticsearch and Open Distro for Elasticsearch K-NN
  ☆117Updated 4 years ago
• MartinoMensio / spacy-dbpedia-spotlight
  A spaCy wrapper for DBpedia Spotlight
  ☆110Updated 2 years ago
• tpopela / vips_java
  Implementation of Vision Based Page Segmentation algorithm in Java
  ☆102Updated 5 years ago
• FraBle / python-sutime
  Python wrapper for Stanford CoreNLP's SUTime
  ☆154Updated 2 years ago