dalab / web2text

Related projects ⓘ

Alternatives and complementary repositories for web2text

• mrjleo / boilernet
  Boilerplate Removal using Deep Learning
  ☆82Updated 2 years ago
• gogartom / TextMaps
  ☆91Updated 8 years ago
• kennethkenneth / AuthorExtractor
  Source code for the Medium article "Extracting the author of news stories with DOM-based segmentation and BERT"
  ☆29Updated 4 years ago
• scrapinghub / article-extraction-benchmark
  Article extraction benchmark: dataset and evaluation scripts
  ☆289Updated 6 months ago
• seomoz / dragnet_data
  Training/test data for Dragnet
  ☆41Updated 9 years ago
• ziyan / spider
  Web Content Extraction Through Machine Learning
  ☆185Updated 10 years ago
• scrapinghub / webstruct
  NER toolkit for HTML data
  ☆257Updated 6 months ago
• dice-group / FOX
  Federated Knowledge Extraction Framework
  ☆191Updated last year
• miso-belica / jusText
  Heuristic based boilerplate removal tool
  ☆729Updated 6 months ago
• CogComp / talen
  A way to do annotations for NER. TALEN: Tool for Annotation of Low-resource ENtities
  ☆112Updated 2 years ago
• seomoz / simhash-py
  Simhash and near-duplicate detection
  ☆410Updated last year
• commoncrawl / news-crawl
  News crawling with StormCrawler - stores content as WARC
  ☆322Updated 11 months ago
• scrapinghub / python-simhash
  An efficient simhash implementation for python
  ☆125Updated 5 years ago
• scrapinghub / mdr
  A python library detect and extract listing data from HTML page.
  ☆109Updated 7 years ago
• explosion / floret
  🌸 fastText + Bloom embeddings for compact, full-coverage vectors with spaCy
  ☆287Updated last year
• EuropeanaNewspapers / ner-corpora
  Named Entity Recognition data for Europeana Newspapers
  ☆173Updated last year
• tokestermw / spacy_hunspell
  Hunspell extension for spaCy 2.0.
  ☆94Updated 3 months ago
• nik0spapp / sdalg
  Web page segmentation and noise removal
  ☆55Updated 9 months ago
• ambiverse-nlu / ambiverse-nlu
  AmbiverseNLU: A Natural Language Understanding suite by Max Planck Institute for Informatics
  ☆208Updated 11 months ago
• mmxgn / spacy-clausie
  Implementation of the ClausIE information extraction system for python+spacy
  ☆220Updated 2 years ago
• matiskay / html-similarity
  Compare html similarity using structural and style metrics
  ☆210Updated last year
• nikitautiu / learnhtml
  Web content extraction using machine learning
  ☆32Updated 3 years ago
• wikilinks / neleval
  Entity disambiguation evaluation and error analysis tool
  ☆116Updated last year
• misja / python-boilerpipe
  Python interface to Boilerpipe, Boilerplate Removal and Fulltext Extraction from HTML pages
  ☆539Updated 3 years ago
• tpopela / vips_java
  Implementation of Vision Based Page Segmentation algorithm in Java
  ☆101Updated 5 years ago
• ikreymer / cdx-index-client
  A command-line tool for using CommonCrawl Index API at http://index.commoncrawl.org/
  ☆181Updated 6 years ago
• DiceTechJobs / VectorsInSearch
  Dice.com repo to accompany the dice.com 'Vectors in Search' talk by Simon Hughes, from the Activate 2018 search conference, and the 'Sear…
  ☆85Updated 3 years ago
• jmriebold / BoilerPy3
  Python port of Boilerpipe library
  ☆85Updated 3 months ago
• uhh-lt / sensegram
  Making sense embedding out of word embeddings using graph-based word sense induction
  ☆212Updated 3 years ago
• JonathanRaiman / wikipedia_ner
  Labeled examples from wiki dumps in Python
  ☆68Updated 8 years ago