Benchmark scripts for comparing different tokenizers and sentence segmenters of German
☆12Feb 27, 2023Updated 3 years ago
Alternatives and similar repositories for Tokenizer-Evaluation
Users that are interested in Tokenizer-Evaluation are comparing it to the libraries listed below
Sorting:
- A Corpus Data Retrieval Index using Lucene for Look-Ups☆19Feb 24, 2026Updated last week
- Translation of query languages to serialized KoralQuery protocol☆13Feb 23, 2026Updated last week
- ☆11Feb 13, 2026Updated 2 weeks ago
- Multi Tier Annotation Search☆12May 13, 2024Updated last year
- This is a new backend implementation of the ANNIS linguistic search and visualization system.☆18Jan 13, 2026Updated last month
- Hexatomic is an extensible software for deep multi-layer annotation of linguistic corpora☆17Nov 27, 2024Updated last year
- ☆16Aug 22, 2023Updated 2 years ago
- Searching in-memory corpus with Corpus Query Language (CQL)☆19Dec 2, 2024Updated last year
- Coquery is a free corpus query tool for linguists, lexicographers, translators, and anybody who wishes to search and analyse a text corpu…☆19Jan 7, 2026Updated last month
- Korpuslinguistik war noch nie so einfach...☆25Feb 18, 2026Updated 2 weeks ago
- Collection de romans français du dix-huitième siècle (1751-1800) / Collection of Eighteenth-Century French Novels (1751-1800)☆23Apr 23, 2024Updated last year
- A superset of brainfuck with dynamic memory management.☆30Oct 2, 2020Updated 5 years ago
- Terminal/Vim dictionary/completion powered by fzf and wordnet☆27Jul 31, 2021Updated 4 years ago
- Mod merging tool for The Witcher 3: Wild Hunt [C++, Qt5]☆12Nov 4, 2016Updated 9 years ago
- A PHP library for comparing two or more Sanskrit TEI XML files and generating an apparatus with variants☆14Feb 16, 2026Updated 2 weeks ago
- What happens when you connect all the ZIP/postal codes in a country in ascending order?☆13Sep 25, 2024Updated last year
- Gazetteer of the Ancient Near East Data☆10Aug 1, 2013Updated 12 years ago
- Scraper for German democracy documents☆44Sep 12, 2023Updated 2 years ago
- Flappy Space Program☆18May 5, 2014Updated 11 years ago
- Choose today's text☆12Dec 9, 2022Updated 3 years ago
- Simple framework for symbolic manipulation☆11Nov 6, 2024Updated last year
- A lexical normalizer for historical spelling variants using a transformer architecture.☆10Mar 12, 2025Updated 11 months ago
- A Simple Sudoku Solver☆23Nov 26, 2012Updated 13 years ago
- ☆10Aug 30, 2025Updated 6 months ago
- Unofficial Knowledge Base for Novel AI☆16Nov 8, 2025Updated 3 months ago
- Oracc GUI☆12Jun 27, 2025Updated 8 months ago
- DApp for a list of validators with metadata for POA Network (Core/Sokol). Validators can update metadata using DApp.☆14Apr 18, 2023Updated 2 years ago
- TEI-encoded contents of the Egyptian Gazette☆15Jun 11, 2024Updated last year
- Basis of FragDenStaat.de's „Koalitionstracker“☆15Jul 14, 2025Updated 7 months ago
- Project to digitize avant-garde periodicals☆12May 13, 2022Updated 3 years ago
- ☆50Oct 14, 2025Updated 4 months ago
- Code for the WP5 NextJS 10 video☆14Nov 2, 2020Updated 5 years ago
- Metalanguage analysis☆10Dec 10, 2018Updated 7 years ago
- Generate static parallel computation graph from DSL at compile time☆11Nov 6, 2024Updated last year
- Implementation in pure Ruby for Microsoft RDP protocol☆10Sep 4, 2016Updated 9 years ago
- natural language processing in the browser - i18n☆10Aug 6, 2015Updated 10 years ago
- New Ultra Fast Lossless Image Codec☆17May 24, 2024Updated last year
- Ruby extra challenges for students☆10Jan 6, 2017Updated 9 years ago
- Scripts to import data into blender for use with testing/benchmarking renderers☆12Dec 15, 2021Updated 4 years ago