🛥 Vaporetto is a fast and lightweight pointwise prediction based tokenizer. This is a Python wrapper for Vaporetto.
☆21Jun 1, 2025Updated 9 months ago
Alternatives and similar repositories for python-vaporetto
Users that are interested in python-vaporetto are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- 敬語変換タスクにおける評価用データセット☆21Nov 24, 2022Updated 3 years ago
- An easy-to-use ML pipeline package for Python inspired by scikit-learn pipeline and PyTorch layers.☆12Aug 27, 2023Updated 2 years ago
- Includes a file with zstd compression in Rust☆13Feb 17, 2023Updated 3 years ago
- Finding all pairs of similar documents time- and memory-efficiently☆62Mar 13, 2025Updated last year
- 🦞 Rust library of natural language dictionaries using character-wise double-array tries.☆37Jan 13, 2025Updated last year
- 🐎 A fast implementation of the Aho-Corasick algorithm using the compact double-array data structure. (Python wrapper for daachorse)☆20Mar 15, 2025Updated last year
- 🛥 Vaporetto: Very accelerated pointwise prediction based tokenizer☆254Feb 7, 2026Updated last month
- Rust binding of primitiv☆20Jun 3, 2018Updated 7 years ago
- ☆14Nov 24, 2022Updated 3 years ago
- Code for COLING 2020 Paper☆13Feb 3, 2026Updated last month
- 法律・判例関係のデータセット☆50Jan 8, 2025Updated last year
- LBFGS optimization algorithm ported from liblbfgs☆12Nov 25, 2022Updated 3 years ago
- Japanese data from the Google UDT 2.0.☆28Mar 24, 2023Updated 3 years ago
- Trials of pre-trained BERT models for the medical domain in Japanese.☆12Nov 21, 2020Updated 5 years ago
- ☆10Sep 14, 2022Updated 3 years ago
- Repository for JSICK☆45May 31, 2023Updated 2 years ago
- Tokyo Metropolitan University Paraphrase Corpus (TMUP)☆11Jun 12, 2017Updated 8 years ago
- This repository has implementations of data augmentation for NLP for Japanese.☆64Feb 16, 2023Updated 3 years ago
- Pytorch implementation and pre-trained Japanese model for CANINE, the efficient character-level transformer.☆89Nov 3, 2023Updated 2 years ago
- Repository of the RANLP 2023 paper "Exploring the Landscape of Natural Language Processing Research".☆13Oct 20, 2024Updated last year
- Tokenizer POS-tagger Lemmatizer and Dependency-parser for modern and contemporary Japanese with BERT models☆20Feb 28, 2026Updated 3 weeks ago
- list of local government in Japan (日本の地方自治体一覧オープンデータ) JSON/CSV☆31Mar 16, 2026Updated last week
- ☆11Aug 3, 2022Updated 3 years ago
- JINS MEME(2021年モデル)のJINS MEME LoggerをPythonのWebSocketサーバーで受信するサンプル☆21Oct 19, 2021Updated 4 years ago
- DIRECT: Direct and Indirect REsponses in Conversational Text Corpus☆17Jul 1, 2021Updated 4 years ago
- Funer is Rule based Named Entity Recognition tool.☆22Apr 21, 2022Updated 3 years ago
- This is a repository for the Travatar forest-to-string translation decoder☆29Aug 7, 2021Updated 4 years ago
- The evaluation scripts of JMTEB (Japanese Massive Text Embedding Benchmark)☆87Mar 16, 2026Updated last week
- Utility scripts for preprocessing Wikipedia texts for NLP☆78Apr 9, 2024Updated last year
- The robust text processing pipeline framework enabling customizable, efficient, and metric-logged text preprocessing.☆124Nov 13, 2025Updated 4 months ago
- 1st place solution source code of Kaggle Happy Whale competition☆58May 24, 2022Updated 3 years ago
- Code and dataset "ZEST" from "Learning from task descriptions", Weller et al, EMNLP 2020☆17Mar 15, 2021Updated 5 years ago
- Python binding of primitiv.☆17Sep 12, 2022Updated 3 years ago
- A tool for comparing tokenizers☆121Nov 9, 2025Updated 4 months ago
- AIME is proposed to address the challenges faced by existing methods in providing intuitive explanations for black-box models.☆14Oct 16, 2025Updated 5 months ago
- lightweight, fast and robust columnar dataframe for data analytics with online update☆23Aug 14, 2021Updated 4 years ago
- 🎤 vibrato: Viterbi-based accelerated tokenizer☆403Feb 7, 2026Updated last month
- A simple implementation of SimCSE☆78Oct 31, 2022Updated 3 years ago
- ☆28Apr 5, 2022Updated 3 years ago