Web Content Extraction Benchmark
☆28Dec 16, 2025Updated 9 months ago
Alternatives and similar repositories for web-content-extraction-benchmark
Users that are interested in web-content-extraction-benchmark are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A Corpus Data Retrieval Index using Lucene for Look-Ups☆20Updated this week
- A lexical normalizer for historical spelling variants using a transformer architecture.☆11Mar 12, 2025Updated last year
- texrex web page cleaning & ClaraX random walk crawler☆11Dec 13, 2021Updated 4 years ago
- Comparing warc files☆17Feb 21, 2019Updated 7 years ago
- ↕️ Intuitive axiomatic retrieval experimentation.☆31Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Official code and dataset for our NAACL 2024 paper: DialogCC: An Automated Pipeline for Creating High-Quality Multi-modal Dialogue Datase…☆13Jun 24, 2024Updated 2 years ago
- GC4LM: A Colossal (Biased) language model for German☆13May 2, 2021Updated 5 years ago
- SFST/SMOR/DWDS-based German Morphology☆26Updated this week
- Machine Learning scripts for the identification of human values behind arguments.☆24Mar 12, 2024Updated 2 years ago
- Neural models for detecting and masking personal information from texts☆16Nov 25, 2022Updated 3 years ago
- 🤝 A proof of concept to find the intersection of bytes between two files on different nodes, without ever revealing the cleartext to the…☆24Nov 15, 2025Updated 10 months ago
- Overview of corpora/datasets for Germanic low-resource languages and dialects. Accompanies "A Survey of Corpora for Germanic Low-Resource…☆28Feb 16, 2026Updated 7 months ago
- Estimation of party positions from Wikipedia tags (see Herrmann/Döring 2021)☆10Aug 22, 2026Updated last month
- Command line tool for digging into WARC files☆51Aug 5, 2026Updated 2 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Translation of query languages to serialized KoralQuery protocol☆15Sep 25, 2026Updated 2 weeks ago
- A trend viewer written in Python/JavaScript☆21Nov 15, 2024Updated last year
- Modules used for separating articles in (historical) newspapers and similar documents. This repository is part of the European Union's Ho…☆23Sep 2, 2022Updated 4 years ago
- code and data used to build a training dataset for dragnet models☆10Nov 29, 2020Updated 5 years ago
- Small string compression using smaz compression algorithm. Fast, because it's in C. Supports Python 3+☆13Oct 18, 2025Updated 11 months ago
- Basis of FragDenStaat.de's „Koalitionstracker“☆16Sep 4, 2026Updated last month
- The Wikinflection Corpus, from the paper "Wikinflection Corpus: A (Better) Multilingual, Morpheme-Annotated Inflectional Corpus" (Metheni…☆12Dec 15, 2023Updated 2 years ago
- Benson turns a list of URLs into mp3s of the contents of each web page - take control over your reading backlog!☆16Oct 30, 2024Updated last year
- [ACL 2024] This is the code repo for our ACL’24 paper "Cleaner Pretraining Corpus Curation with Neural Web Scraping".☆229Aug 28, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- A reddit bot that finds original publish dates on linked articles.☆10Nov 30, 2024Updated last year
- A Python scraping module, that extracts text from articles found in RSS feeds. Uses SQLite as database.☆21Jul 5, 2024Updated 2 years ago
- Data Management with SQL for Social Scientists☆12Updated this week
- Calculating Expected Time for training LLM.☆39Apr 17, 2023Updated 3 years ago
- Backend, IA-specific tools for crawling and processing the scholarly web. Content ends up in https://fatcat.wiki☆28Jul 31, 2024Updated 2 years ago
- ParlaMint: Comparable Parliamentary Corpora☆88Mar 31, 2026Updated 6 months ago
- Code repository for the paper "Mission: Impossible Language Models."☆57Sep 25, 2025Updated last year
- [WWW 2026] 🕸 GlotWeb: Web Indexing for Minority Languages☆17Apr 14, 2026Updated 5 months ago
- a webapp that helps you listen to colors, see also the first version here, http://www.synestizer.com allow camera and microphone if promp…☆11Jul 10, 2026Updated 3 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Social Science Workshop Overview☆17Updated this week
- ☆13Dec 16, 2024Updated last year
- Evaluate language models using multiple choice items☆13Mar 6, 2026Updated 7 months ago
- ☆30Jul 17, 2019Updated 7 years ago
- A compact high-signal benchmark for evaluating frontier agents☆40Aug 3, 2026Updated 2 months ago
- Tool to bulk follow accounts related Open Science on Mastodon. Runs at https://germanrepro.github.io/Mastodon-OpenScience/ Based on the D…☆16Aug 22, 2026Updated last month
- React Native app for DoYou.world☆16Jan 21, 2026Updated 8 months ago