Alternatives and similar repositories for web2text

Users that are interested in web2text are comparing it to the libraries listed below

• mrjleo / boilernet
  Boilerplate Removal using Deep Learning
  ☆82Updated 3 years ago
• kennethkenneth / AuthorExtractor
  Source code for the Medium article "Extracting the author of news stories with DOM-based segmentation and BERT"
  ☆29Updated 5 years ago
• scrapinghub / article-extraction-benchmark
  Article extraction benchmark: dataset and evaluation scripts
  ☆318Updated last year
• gogartom / TextMaps
  ☆91Updated 9 years ago
• fnl / syntok
  Text tokenization and sentence segmentation (segtok v2)
  ☆205Updated 3 years ago
• CogComp / talen
  A way to do annotations for NER. TALEN: Tool for Annotation of Low-resource ENtities
  ☆115Updated 3 years ago
• miso-belica / jusText
  Heuristic based boilerplate removal tool
  ☆784Updated 4 months ago
• falcony-io / ml-annotate
  Use ML-Annotate to label data for machine learning purposes
  ☆109Updated 4 years ago
• HazyResearch / bootleg
  Self-Supervision for Named Entity Disambiguation at the Tail
  ☆218Updated 3 years ago
• seomoz / dragnet_data
  Training/test data for Dragnet
  ☆41Updated 10 years ago
• chschock / textsplit
  Segment documents into coherent parts using word embeddings.
  ☆149Updated 3 years ago
• textpipe / textpipe
  Textpipe: clean and extract metadata from text
  ☆302Updated 4 years ago
• nreimers / truecaser
  Language independent truecaser in Python.
  ☆160Updated 3 years ago
• crabcamp / lexrank
  LexRank algorithm for text summarization
  ☆231Updated last year
• mmxgn / spacy-clausie
  Implementation of the ClausIE information extraction system for python+spacy
  ☆224Updated 2 years ago
• seomoz / simhash-py
  Simhash and near-duplicate detection
  ☆416Updated 2 years ago
• dbpedia-spotlight / spotlight-docker
  Docker containers for DBpedia Spotlight
  ☆74Updated last year
• MartinoMensio / spacy-universal-sentence-encoder
  Google USE (Universal Sentence Encoder) for spaCy
  ☆184Updated 2 years ago
• gaetangate / text-summarizer
  Python Framework for Extractive Text Summarization
  ☆113Updated 3 years ago
• bsolomon1124 / pycld3
  Python3 bindings for the Compact Language Detector v3 (CLD3)
  ☆152Updated 2 years ago
• nickdavidhaynes / spacy-cld
  Language detection extension for spaCy 2.0+
  ☆113Updated 6 years ago
• helloeve / universal-sentence-encoder-fine-tune
  ☆72Updated 7 years ago
• tsproisl / SoMaJo
  A tokenizer and sentence splitter for German and English web and social media texts.
  ☆146Updated 7 months ago
• kermitt2 / delft
  a Deep Learning Framework for Text https://delft.readthedocs.io/
  ☆400Updated last month
• commoncrawl / news-crawl
  News crawling with StormCrawler - stores content as WARC
  ☆351Updated 4 months ago
• tokestermw / spacy_hunspell
  Hunspell extension for spaCy 2.0.
  ☆94Updated 11 months ago
• oaqa / FlexNeuART
  Flexible classic and NeurAl Retrieval Toolkit
  ☆218Updated 2 weeks ago
• EuropeanaNewspapers / ner-corpora
  Named Entity Recognition data for Europeana Newspapers
  ☆172Updated 2 years ago
• yannvgn / laserembeddings
  LASER multilingual sentence embeddings as a pip package
  ☆224Updated last year
• kevinlu1248 / pyate
  PYthon Automated Term Extraction
  ☆314Updated 2 years ago