A character-wise tokenizer for morphologically rich languages
☆32Jun 15, 2026Updated 2 months ago
Alternatives and similar repositories for RFTokenizer
Users that are interested in RFTokenizer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- An NLP pipeline for Hebrew☆42Jun 16, 2025Updated last year
- Named Entity (NER) annotations of the Hebrew Treebank (Haaretz newspaper) corpus, including: morpheme and token level NER labels, nested …☆11Dec 27, 2021Updated 4 years ago
- A fork of languagetool to maintain Arabic☆18Mar 22, 2025Updated last year
- Arabic flexionnal morphology generator☆35Aug 28, 2024Updated last year
- Repository for DISRPT2023 shared task☆17Jul 26, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Public repository for Coptic SCRIPTORIUM Corpora Releases☆49Jul 27, 2026Updated 3 weeks ago
- Scripts for compatibilitising between VISL-CG3, Apertium, CoNLL-X and Universal Dependencies☆17Mar 4, 2020Updated 6 years ago
- ☆10May 6, 2026Updated 3 months ago
- Dataset of the Samaritan Pentateuch☆15Jul 17, 2026Updated last month
- Training files for Greek cursive script (in early print)☆15May 26, 2021Updated 5 years ago
- Fast corpus search engine originally made for the Corpus of Written Tatar language☆17Nov 9, 2019Updated 6 years ago
- This is the development repository for The Oxford-BYU Syriac Corpus project.☆16Mar 10, 2026Updated 5 months ago
- Repository for DISRPT2019 shared task☆12Sep 5, 2022Updated 3 years ago
- Arabic named entity recognition using AnerCorp corpus (location , organisation, person, Miscellaneous Word)☆37Jul 28, 2017Updated 9 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- The complete [1 to 5]-gram Gumar Corpus in the style of Google n-grams.☆12Feb 5, 2020Updated 6 years ago
- ☆18Jan 13, 2021Updated 5 years ago
- sentiment analysis models for Arabic tweets to analyze Twitter comments as having positive, negative or neutral sentiments.☆13Mar 17, 2018Updated 8 years ago
- ☆64Feb 2, 2023Updated 3 years ago
- Repository for rstWeb, a browser based annotation interface for Rhetorical Structure Theory☆48Aug 15, 2025Updated last year
- Dead Sea Scrolls in TF format based on Abegg's data☆31Aug 10, 2026Updated last week
- Repository for the Georgetown University Multilayer Corpus (GUM)☆111Jun 8, 2026Updated 2 months ago
- A field-tested Hebrew tokenizer for dirty texts (ben-yehuda project, bible, cc100, mc4, opensubs, oscar, twitter) focused on multi-word e…☆23Aug 13, 2022Updated 4 years ago
- Arabic poetry analysis and generation.☆26Jul 23, 2023Updated 3 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- AlephBertGimmel - Modern Hebrew pretrained BERT model with a 128K token vocabulary.☆27Dec 1, 2022Updated 3 years ago
- Firefox and Chrome compatible extension that acts as annotation tool for websites (Named Entity Recognition)☆10Feb 17, 2019Updated 7 years ago
- The dictionary comprised of the Coptic lexicon created by the BBAW and interface by Coptic SCRIPTORIUM. Currently deployed at https://co…☆34Updated this week
- Repository for GitDOX, a GitHub Data-storage Online XML editor☆17Updated this week
- Ya (ي) programming language is an open-source programming language where you can write python code in the Arabic language.☆43Jan 31, 2019Updated 7 years ago
- ORSH - is an Oranios simple shell written in order to understand how shells work .☆12Jun 12, 2024Updated 2 years ago
- ☆14Dec 28, 2022Updated 3 years ago
- ☆30Feb 1, 2020Updated 6 years ago
- Social Context Analysis aNd Emotion Recognition☆12Jul 11, 2017Updated 9 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- collection of code for helping me get things done☆16Feb 21, 2022Updated 4 years ago
- A VanillaJS take on Clojure's fantastic re-frame library☆13Dec 31, 2019Updated 6 years ago
- TEI-encoded contents of the Egyptian Gazette☆15Jun 6, 2026Updated 2 months ago
- Arabic support for textblob☆87Oct 21, 2021Updated 4 years ago
- This dataset contains naturally-occurring English sentences that feature non-trivial noun-verb ambiguity.☆38Apr 26, 2019Updated 7 years ago
- Word embeddings from PPMI-weighted and dirichlet-smoothed co-occurrence matrices☆10Aug 3, 2020Updated 6 years ago
- ☆15Apr 12, 2023Updated 3 years ago