universal tokenizer
☆17Nov 29, 2021Updated 4 years ago
Alternatives and similar repositories for utoken
Users that are interested in utoken are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆18Jul 30, 2018Updated 8 years ago
- Guidelines for our secondary layer of annotation adding multi-sentence AMR links☆12Sep 6, 2017Updated 9 years ago
- Tweets annotated with coarse-grained sense labels (supersenses)☆13Jun 13, 2014Updated 12 years ago
- Public domain/free license Bibles for UniqueBible.app☆12Jul 14, 2025Updated last year
- A home for collaboration on construction of a multilingual FrameNet☆13Aug 25, 2017Updated 9 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Universal Romanizer that can convert any unicode script to roman (latin) script☆252Jul 26, 2024Updated 2 years ago
- [WIP] A TSX-like language that's safer, more functional, and compiles to JSX.☆12Jun 19, 2025Updated last year
- A tool that locates, downloads, and extracts machine translation corpora☆167Apr 13, 2026Updated 5 months ago
- Scripts investigate, repair and normalize a wide range of text file problems at the character level.☆23May 25, 2026Updated 4 months ago
- A set of pipelines for performing experiments on various NLP tasks with a focus on resource-poor/minority languages.☆39Updated this week
- Deeplearning4j Examples (DL4J, DL4J Spark, DataVec)☆10Aug 16, 2018Updated 8 years ago
- An elegant USFM parser.☆61Sep 13, 2026Updated 2 weeks ago
- A library for data streaming and augmentation☆22May 5, 2025Updated last year
- A Webpack loader for the Nim language☆13Apr 2, 2026Updated 5 months ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- Official repository for the Solid Rock Hebrew Bible☆19Apr 20, 2026Updated 5 months ago
- Package for reading in FrameNet data and performing operations on it, such as creating ECG grammars.☆30Mar 6, 2020Updated 6 years ago
- Semantic Privacy Guard: A Java middleware that intercepts text, identifies PII using a three-layer hybrid pipeline (Regex + Naive Bayes M…☆20Jun 14, 2026Updated 3 months ago
- ISI tutorials☆12Oct 28, 2016Updated 9 years ago
- The Arborator software is aimed at collaboratively annotating dependency corpora.☆26Nov 5, 2019Updated 6 years ago
- Web based argument mapping tools☆19Jul 17, 2023Updated 3 years ago
- Code for Unsupervised Learning of Morphological Forest☆14Aug 12, 2019Updated 7 years ago
- Tensorflow data structures generated from protobuf definitions☆19Oct 31, 2017Updated 8 years ago
- Simple command line XML Merge tool☆13Aug 9, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A Bible translation editor for everyone.☆13Jan 3, 2023Updated 3 years ago
- Code for extracting parallel corpora from pmindia☆17Jan 28, 2020Updated 6 years ago
- Official repository for Semlink resources☆42Jan 27, 2022Updated 4 years ago
- Precise type-checker for JavaScript☆11Oct 23, 2025Updated 11 months ago
- Python asynchronous library for web scrapping☆12Aug 24, 2021Updated 5 years ago
- [GO - Fiber] Fiber Starter Project - Session Based Auth - Server Side Rendering☆13Apr 4, 2026Updated 5 months ago
- A Radix Tree based router for HTTP and other routing needs with support for middlewares and endpoints with a Cython boost☆15Oct 9, 2018Updated 7 years ago
- ☆37Feb 6, 2014Updated 12 years ago
- Alterive bpe loader for tiktoken-go☆17Sep 10, 2025Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- The definitive collection of is* functions for runtime type checking. Lodash-compatible, tree-shakable, with types.☆17Jul 17, 2026Updated 2 months ago
- Go stemmers generated by the Snowball project☆25Sep 6, 2020Updated 6 years ago
- Another micro-framework☆21Jan 4, 2017Updated 9 years ago
- ☆19Mar 4, 2017Updated 9 years ago
- For interacting with nutch via Python☆29Jul 5, 2026Updated 2 months ago
- Archived origin of secryst/secryst-train/arabic — full history merged there.☆13Sep 17, 2026Updated last week
- An experimental USFM Bible translation editor written in Python with Tkinter☆23Oct 17, 2022Updated 3 years ago