Source code for the paper "Web2Text: Deep Structured Boilerplate Removal", full paper @ ECIR'18
☆170Oct 28, 2021Updated 4 years ago
Alternatives and similar repositories for web2text
Users that are interested in web2text are comparing it to the libraries listed below
Sorting:
- Source code for the Medium article "Extracting the author of news stories with DOM-based segmentation and BERT"☆29Jan 16, 2020Updated 6 years ago
- Web content extraction using machine learning☆34Mar 3, 2021Updated 5 years ago
- Content Extraction via Text Density (SIGIR11)☆25Sep 21, 2015Updated 10 years ago
- Just the facts -- web page content extraction☆1,279Jul 8, 2025Updated 8 months ago
- texrex web page cleaning & ClaraX random walk crawler☆11Dec 13, 2021Updated 4 years ago
- Article extraction benchmark: dataset and evaluation scripts☆356Mar 1, 2026Updated 2 weeks ago
- Official repository of "Efficient and Effective Query Expansion for Web Search", Short Paper @ CIKM 2018☆15Nov 17, 2019Updated 6 years ago
- Intelligent Web Data Extractor☆74Dec 5, 2022Updated 3 years ago
- Heuristic based boilerplate removal tool☆814Feb 25, 2025Updated last year
- Tutorial on Web Table Extraction, Retrieval and Augmentation☆11Mar 28, 2020Updated 5 years ago
- ☆16Apr 9, 2021Updated 4 years ago
- Rules used in Neural Rule Engine.☆28Aug 31, 2018Updated 7 years ago
- Framework for evaluating text extraction algorithms implemented as web services☆42Jun 30, 2012Updated 13 years ago
- A fork of Dragnet that also extract author, headline, date, keywords from context, as well as built in metadata extraction all in one pac…☆300May 19, 2025Updated 10 months ago
- F# LL(k) Parser generator.☆12Oct 26, 2022Updated 3 years ago
- A neural text process python lib for context-based feature extraction on Seq-Tagging data.☆10Jul 27, 2018Updated 7 years ago
- Code for paper "Neural Semi-Markov Conditional Random Fields for Robust Character-Based Part-of-Speech Tagging"☆16May 31, 2019Updated 6 years ago
- Simple heuristic for measuring web page similarity (& data set)☆91Feb 23, 2026Updated 3 weeks ago
- Web Content Extraction Through Machine Learning☆185Apr 4, 2014Updated 11 years ago
- Don't Count, Predict! An Automatic Approach to Learning Sentiment Lexicons for Short Text☆13Jul 20, 2016Updated 9 years ago
- A multi-language segmenter using high-order CRF.☆17Feb 27, 2020Updated 6 years ago
- Inference with state-of-the-art models (pre-trained by LD-Net / AutoNER / VanillaNER / ...)☆118Dec 15, 2018Updated 7 years ago
- Knowledge extraction from semi-structured web.☆13Mar 25, 2024Updated last year
- TextFlows is an open-source online platform for composition, execution, and sharing of interactive text mining and natural language proce…☆19Dec 1, 2017Updated 8 years ago
- Implementation of Deep Dirichlet Multinomial Regression in python + cython.☆16Mar 7, 2018Updated 8 years ago
- WebConf 2020 paper Leading Conversational Search by Suggesting Useful Questions☆33May 4, 2020Updated 5 years ago
- ☆22Jun 12, 2023Updated 2 years ago
- DKPro C4CorpusTools is a collection of tools for processing CommonCrawl corpus, including Creative Commons license detection, boilerplate…☆52Jun 12, 2020Updated 5 years ago
- Python interface to Boilerpipe, Boilerplate Removal and Fulltext Extraction from HTML pages☆541Jul 17, 2021Updated 4 years ago
- Information extraction from English and German texts based on predicate logic☆143Jun 6, 2023Updated 2 years ago
- A python implementation of DEPTA☆83Jan 14, 2017Updated 9 years ago
- Neural-IR-Explorer: A Content-Focused Tool to Explore Neural Re-Ranking Results☆32Dec 13, 2019Updated 6 years ago
- Converter from UD-trees to BART representation☆35Mar 6, 2024Updated 2 years ago
- Tutorial on NE processing for Digital Humanities - DH Utrech 2019☆24Jul 18, 2019Updated 6 years ago
- Scrapy middleware for the autologin☆37Feb 10, 2026Updated last month
- Show summary of a large number of URLs in a Jupyter Notebook☆19Feb 10, 2026Updated last month
- python interface for mate tools☆17Jan 23, 2018Updated 8 years ago
- Dataset for the ACL 2015 paper : Learning to Explain Entity Relationships in Knowledge Graphs☆11Oct 22, 2015Updated 10 years ago
- A dataset consisting of 502 English dialogs with 12,000 annotated utterances between a user and an assistant discussing movie preferences…☆28Jan 20, 2021Updated 5 years ago