megagonlabs / ginza-transformers
Use custom tokenizers in spacy-transformers
☆16Updated 2 years ago
Alternatives and similar repositories for ginza-transformers:
Users that are interested in ginza-transformers are comparing it to the libraries listed below
- Funer is Rule based Named Entity Recognition tool.☆22Updated 2 years ago
- Japanese data from the Google UDT 2.0.☆28Updated 2 years ago
- Code for COLING 2020 Paper☆13Updated 3 weeks ago
- AllenNLP integration for Shiba: Japanese CANINE model☆12Updated 3 years ago
- Japanese synonym library☆53Updated 3 years ago
- Python implementation of SWEM (Simple Word-Embedding-based Methods)☆29Updated 2 years ago
- This repository has implementations of data augmentation for NLP for Japanese.☆64Updated 2 years ago
- Japanese tokenizer for Transformers☆80Updated last year
- Evidence-based Explanation Dataset (AACL-IJCNLP 2020)☆18Updated 4 years ago
- Japanese Realistic Textual Entailment Corpus (NLP 2020, LREC 2020)☆75Updated last year
- 日本語テキストに対する wikification のためのソフトウェア☆15Updated 8 years ago
- Wikipediaから作成した日本語名寄せデータセット☆35Updated 5 years ago
- A Japanese dependency parser based on BERT☆22Updated 2 years ago
- Japanese BERT Pretrained Model☆22Updated 3 years ago
- ☆17Updated last year
- Annotated Fuman Kaitori Center Corpus☆17Updated last year
- ☆20Updated 4 years ago
- ☆36Updated 4 years ago
- ☆18Updated 10 months ago
- Python Implementation of EmbedRank☆49Updated 6 years ago
- A paraphrase database for Japanese text simplification☆32Updated 8 years ago
- Repository for JSICK☆44Updated last year
- This is the repository for TRF (text readability features) publication.☆39Updated 5 years ago
- ☆25Updated last week
- Japanese BERT trained on Aozora Bunko and Wikipedia, pre-tokenized by MeCab with UniDic & SudachiPy☆40Updated 4 years ago
- Zunda: Japanese Enhanced Modality Analyzer client for Python.☆10Updated 5 years ago
- Utility scripts for preprocessing Wikipedia texts for NLP☆76Updated 11 months ago
- Namelti : The automatic transcription generation library for person name in Katakana☆21Updated last year
- ☆35Updated 4 years ago
- japanese sentence segmentation library for python☆70Updated last year