Alternatives and similar repositories for web2text

Users that are interested in web2text are comparing it to the libraries listed below

• mrjleo / boilernet
  Boilerplate Removal using Deep Learning
  ☆82Updated 3 years ago
• gogartom / TextMaps
  ☆91Updated 9 years ago
• nikitautiu / learnhtml
  Web content extraction using machine learning
  ☆34Updated 4 years ago
• scrapinghub / article-extraction-benchmark
  Article extraction benchmark: dataset and evaluation scripts
  ☆337Updated last month
• kennethkenneth / AuthorExtractor
  Source code for the Medium article "Extracting the author of news stories with DOM-based segmentation and BERT"
  ☆29Updated 5 years ago
• fnl / syntok
  Text tokenization and sentence segmentation (segtok v2)
  ☆207Updated 3 years ago
• CogComp / talen
  A way to do annotations for NER. TALEN: Tool for Annotation of Low-resource ENtities
  ☆118Updated 4 months ago
• seomoz / simhash-py
  Simhash and near-duplicate detection
  ☆420Updated 2 years ago
• falcony-io / ml-annotate
  Use ML-Annotate to label data for machine learning purposes
  ☆110Updated 5 years ago
• crabcamp / lexrank
  LexRank algorithm for text summarization
  ☆231Updated last year
• scrapinghub / webstruct
  NER toolkit for HTML data
  ☆259Updated last year
• dbpedia-spotlight / spotlight-docker
  Docker containers for DBpedia Spotlight
  ☆74Updated 2 years ago
• FraBle / python-sutime
  Python wrapper for Stanford CoreNLP's SUTime
  ☆159Updated 2 years ago
• fnl / segtok
  Segtok v2 is here: https://github.com/fnl/syntok -- A rule-based sentence segmenter (splitter) and a word tokenizer using orthographic fe…
  ☆170Updated 3 years ago
• aboSamoor / pycld2
  ☆175Updated 7 months ago
• bsolomon1124 / pycld3
  Python3 bindings for the Compact Language Detector v3 (CLD3)
  ☆154Updated 2 years ago
• miso-belica / jusText
  Heuristic based boilerplate removal tool
  ☆804Updated 8 months ago
• HazyResearch / bootleg
  Self-Supervision for Named Entity Disambiguation at the Tail
  ☆218Updated 3 years ago
• ziyan / spider
  Web Content Extraction Through Machine Learning
  ☆184Updated 11 years ago
• yannvgn / laserembeddings
  LASER multilingual sentence embeddings as a pip package
  ☆225Updated 2 years ago
• mmxgn / spacy-clausie
  Implementation of the ClausIE information extraction system for python+spacy
  ☆226Updated 3 years ago
• ambiverse-nlu / ambiverse-nlu
  AmbiverseNLU: A Natural Language Understanding suite by Max Planck Institute for Informatics
  ☆212Updated last year
• chschock / textsplit
  Segment documents into coherent parts using word embeddings.
  ☆149Updated 3 years ago
• dbpedia-spotlight / dbpedia-spotlight-model
  DBpedia Spotlight is a tool for automatically annotating mentions of DBpedia resources in text. Improving Efficiency and Accuracy in Mult…
  ☆182Updated 2 years ago
• commoncrawl / news-crawl
  News crawling with StormCrawler - stores content as WARC
  ☆358Updated 8 months ago
• nreimers / truecaser
  Language independent truecaser in Python.
  ☆160Updated 4 years ago
• gaetangate / text-summarizer
  Python Framework for Extractive Text Summarization
  ☆113Updated 4 years ago
• textpipe / textpipe
  Textpipe: clean and extract metadata from text
  ☆302Updated 4 years ago
• MartinoMensio / spacy-universal-sentence-encoder
  Google USE (Universal Sentence Encoder) for spaCy
  ☆184Updated 2 years ago
• oaqa / FlexNeuART
  Flexible classic and NeurAl Retrieval Toolkit
  ☆220Updated 4 months ago