This is the repository for MorphScore, a tokenizer evaluation framework for morphological alignment.
☆18Jul 10, 2025Updated last year
Alternatives and similar repositories for morphscore
Users that are interested in morphscore are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- TokEval: intrinsic quality metrics for tokenizers across natural language, code, and math☆47Updated this week
- Code for the paper "Greed is All You Need: An Evaluation of Tokenizer Inference Methods"☆15Nov 26, 2024Updated last year
- Metric Space Magnitude Computations☆15Jun 30, 2026Updated last month
- Source code for paper Grammatical Error Correction in Low-Resource Scenarios (W-NUT 2019)☆13Jun 21, 2022Updated 4 years ago
- LTG-Bert☆35Jan 8, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Code for "Mind Your Inflections! Improving NLP for Non-Standard Englishes with Base-Inflection Encoding" (EMNLP 2020).☆11May 1, 2025Updated last year
- AI SUGGEST is a powerful command-line assistant that leverages AI to provide accurate Linux commands based on natural language queries. S…☆11Aug 22, 2024Updated last year
- ☆14Feb 1, 2024Updated 2 years ago
- Complete set of English dialect transformation rules and evaluation code☆16Jun 7, 2024Updated 2 years ago
- ☆10Jun 19, 2019Updated 7 years ago
- HELP: a dataset for Handling Entailments with Lexical and logical Phenomena (Ver.1.0)☆15Jul 20, 2023Updated 3 years ago
- ☆12Apr 19, 2022Updated 4 years ago
- ☆10Nov 8, 2023Updated 2 years ago
- Tools for calculating psycholinguistically-relevant metrics of language statistics using transformer language models☆13Nov 11, 2022Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆15Aug 2, 2024Updated 2 years ago
- Calculates bounds on the sofa moving problem☆14Sep 12, 2019Updated 6 years ago
- Split bib files for anthology bibliography for overleaf☆11Aug 25, 2024Updated last year
- A list of resources dedicated to compositionality☆14Feb 21, 2019Updated 7 years ago
- Tutorial for the PRIMs architecture☆14Mar 31, 2023Updated 3 years ago
- The Earleyx parser was originated from Roger Levy's prefix parser, but has evolved significantly. Earleyx can generate Viterbi parses and…☆14Mar 27, 2014Updated 12 years ago
- Morfessor is a tool for unsupervised and semi-supervised morphological segmentation☆207Oct 6, 2020Updated 5 years ago
- BPE modification that implements removing of the intermediate tokens during tokenizer training.☆27Nov 25, 2024Updated last year
- ☆10Sep 13, 2022Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- PhD thesis template with title page according to the University of Amsterdam.☆17Sep 12, 2021Updated 4 years ago
- Dialogue Act classification☆18Jan 15, 2024Updated 2 years ago
- Syntactic evaluation sets, attribute-varying grammars, and code for replicating the CLAMS paper. ACL 2020.☆17Nov 26, 2024Updated last year
- The repository of CLEME (EMNLP 2023) and CLEME2.0 (ACL 2025)☆12May 17, 2025Updated last year
- ☆13Jul 10, 2020Updated 6 years ago
- Gradient accumulation on tf.estimator☆12Dec 15, 2020Updated 5 years ago
- ☆19Nov 4, 2025Updated 9 months ago
- A series of BERT and Albert model checkpoints trained to reduce gendered correlations in pre-training☆11Oct 22, 2020Updated 5 years ago
- Trained a 114 million Parameter LLM from Scratch.☆19Jul 21, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- TSAR2022 Shared Task on Lexical Simplification - Datasets and Evaluation scripts☆10Oct 27, 2022Updated 3 years ago
- Code for "Guiding Large Language Models to Post-Edit Machine Translation with Error Annotations" [NAACL Findings 2024]☆14Apr 3, 2026Updated 4 months ago
- List of corpora annotated for coreference for different languages☆18Aug 8, 2024Updated 2 years ago
- ☆10May 26, 2022Updated 4 years ago
- ISI tutorials☆12Oct 28, 2016Updated 9 years ago
- Pretraining scripts for BART transformer model☆12May 15, 2023Updated 3 years ago
- GA algorithm to solve bin packing and production scheduling problems☆15Sep 11, 2022Updated 3 years ago