megagonlabs / ginza-transformers
Use custom tokenizers in spacy-transformers
☆16Updated 2 years ago
Alternatives and similar repositories for ginza-transformers:
Users that are interested in ginza-transformers are comparing it to the libraries listed below
- Japanese data from the Google UDT 2.0.☆28Updated last year
- Code for COLING 2020 Paper☆13Updated 2 weeks ago
- Funer is Rule based Named Entity Recognition tool.☆22Updated 2 years ago
- AllenNLP integration for Shiba: Japanese CANINE model☆12Updated 3 years ago
- Japanese synonym library☆53Updated 3 years ago
- Japanese tokenizer for Transformers☆80Updated last year
- This repository has implementations of data augmentation for NLP for Japanese.☆64Updated 2 years ago
- This is the repository for TRF (text readability features) publication.☆39Updated 5 years ago
- ☆7Updated 3 years ago
- Japanese Realistic Textual Entailment Corpus (NLP 2020, LREC 2020)☆76Updated last year
- Repository for JSICK☆44Updated last year
- Python implementation of SWEM (Simple Word-Embedding-based Methods)☆29Updated 2 years ago
- Wikipediaから作成した日本語名寄せデータセット☆34Updated 4 years ago
- ☆18Updated last year
- A Japanese dependency parser based on BERT☆22Updated 2 years ago
- Annotated Fuman Kaitori Center Corpus☆17Updated last year
- Japanese BERT Pretrained Model☆22Updated 3 years ago
- Evidence-based Explanation Dataset (AACL-IJCNLP 2020)☆18Updated 4 years ago
- Utility scripts for preprocessing Wikipedia texts for NLP☆76Updated 10 months ago
- Japanese BERT trained on Aozora Bunko and Wikipedia, pre-tokenized by MeCab with UniDic & SudachiPy☆40Updated 4 years ago
- ☆25Updated 8 months ago
- ☆18Updated 8 months ago
- 日本語テキストに対する wikification のためのソフトウェア☆15Updated 7 years ago
- Yet another sentence-level tokenizer for the Japanese text☆22Updated 2 years ago
- DIRECT: Direct and Indirect REsponses in Conversational Text Corpus☆16Updated 3 years ago
- 敬語変換タスクにおける評価用データセット☆20Updated 2 years ago
- ☆36Updated 4 years ago
- Kyoto University Web Document Leads Corpus☆80Updated last year
- docker for UTH-BERT: https://ai-health.m.u-tokyo.ac.jp/uth-bert☆14Updated last year
- Python Implementation of EmbedRank☆49Updated 5 years ago