daac-tools / python-vaporetto
🛥 Vaporetto is a fast and lightweight pointwise prediction based tokenizer. This is a Python wrapper for Vaporetto.
☆20Updated 3 weeks ago
Alternatives and similar repositories for python-vaporetto:
Users that are interested in python-vaporetto are comparing it to the libraries listed below
- Japanese synonym library☆53Updated 3 years ago
- This repository has implementations of data augmentation for NLP for Japanese.☆64Updated 2 years ago
- Funer is Rule based Named Entity Recognition tool.☆22Updated 2 years ago
- Japanese Realistic Textual Entailment Corpus (NLP 2020, LREC 2020)☆75Updated last year
- ☆26Updated 4 months ago
- Japanese tokenizer for Transformers☆80Updated last year
- Repository for JSICK☆44Updated last year
- ☆20Updated 4 years ago
- Code for COLING 2020 Paper☆13Updated 3 weeks ago
- ☆50Updated last year
- Wikipediaを用いた日本語の固有表現抽出データセット☆136Updated last year
- Wikipediaから作成した日本語名寄せデータセット☆35Updated 5 years ago
- Japanese data from the Google UDT 2.0.☆28Updated 2 years ago
- Finding all pairs of similar documents time- and memory-efficiently☆60Updated 3 weeks ago
- ☆21Updated 2 years ago
- ☆34Updated 5 years ago
- ☆36Updated 4 years ago
- Exploring Japanese SimCSE☆69Updated last year
- 敬語変換タスクにおける評価用データセット☆21Updated 2 years ago
- ☆49Updated 2 years ago
- おーぷん2ちゃんねるをクロールして作成した対話コーパス☆95Updated 3 years ago
- Japanese-BPEEncoder☆41Updated 3 years ago
- This is the repository for TRF (text readability features) publication.☆39Updated 5 years ago
- Viterbi-based accelerated tokenizer (Python wrapper)☆41Updated 6 months ago
- Python implementation of SWEM (Simple Word-Embedding-based Methods)☆29Updated 2 years ago
- ☆97Updated last year
- Sentence Embeddings with BERT & XLNet☆32Updated last year
- An integrated Japanese analyzer based on foundation models☆131Updated 6 months ago
- 【2024年版】BERTによるテキスト分類☆29Updated 8 months ago
- japanese sentence segmentation library for python☆70Updated 2 years ago