nlp-waseda / Kanbun-LMLinks
Code for paper "Kanbun-LM: Reading and Translating Classical Chinese in Japanese Method by Language Models"
☆17Updated 2 years ago
Alternatives and similar repositories for Kanbun-LM
Users that are interested in Kanbun-LM are comparing it to the libraries listed below
Sorting:
- A small version of UniDic for easy pip installs.☆44Updated 4 years ago
- Tokenizer POS-Tagger and Dependency-parser with BERT/RoBERTa/DeBERTa/GPT models for Japanese and other languages☆52Updated 3 months ago
- Unidic packaged for installation via pip.☆99Updated 5 months ago
- English loanwords in Japanese☆18Updated 9 months ago
- ☆20Updated 4 years ago
- COMET-ATOMIC ja☆30Updated last year
- A Japanese accent dictionary generator☆118Updated last year
- ☆42Updated last year
- Scripts for creating a Japanese-English parallel corpus and training NMT models☆17Updated 3 years ago
- Coursera Corpus Mining and Multistage Fine-Tuning for Improving Lectures Translation☆14Updated 11 months ago
- ☆51Updated 2 years ago
- Utility scripts for preprocessing Wikipedia texts for NLP☆77Updated last year
- Kyoto University Text Corpus☆64Updated 2 years ago
- 全国書誌データから作成した振り仮名のデータセット☆27Updated 3 years ago
- 粵文語料篩選器 Cantonese text filter☆40Updated 4 months ago
- Tokenizer POS-tagger Lemmatizer and Dependency-parser for modern and contemporary Japanese☆37Updated 8 months ago
- Yet another Python binding for Juman++/KNP/KWJA☆33Updated last week
- A powerful text cleaner for Japanese web texts☆12Updated last year
- Dictionary of pairs of Korean word and IPA crawled from Wiktionary (Korean edition)☆21Updated 2 years ago
- Tokenizer POS-tagger Lemmatizer and Dependency-parser for modern and contemporary Japanese with BERT models☆20Updated 4 months ago
- 日本語マルチタスク言語理解ベンチマーク Japanese Massive Multitask Language Understanding Benchmark☆36Updated 7 months ago
- 🌿 An easy-to-use Japanese Text Processing tool, which makes it possible to switch tokenizers with small changes of code.☆253Updated 3 months ago
- A library for minimum Bayes risk (MBR) decoding☆45Updated 2 months ago
- The Business Scene Dialogue corpus☆69Updated 3 years ago
- AMI Meeting Parallel Corpus☆11Updated 4 years ago
- 日本語文法誤り訂正ツール☆29Updated 3 years ago
- LLM構築用の日本語チャットデータセット☆85Updated last year
- ☆34Updated 2 years ago
- A large parallel corpus of English and Japanese☆84Updated 7 years ago
- Japanese-BPEEncoder Version 2☆41Updated 2 years ago