Distributed representations of words and named entities trained on Wikipedia.
☆183May 11, 2021Updated 4 years ago
Alternatives and similar repositories for WikiEntVec
Users that are interested in WikiEntVec are comparing it to the libraries listed below
Sorting:
- Japanese text normalizer for mecab-neologd☆286Dec 2, 2025Updated 3 months ago
- 📝 A list of pre-trained BERT models for Japanese with word/subword tokenization + vocabulary construction algorithm information☆131Mar 15, 2023Updated 2 years ago
- Japanese word embedding with Sudachi and NWJC 🌿☆171Mar 1, 2024Updated 2 years ago
- ☆25Jan 25, 2019Updated 7 years ago
- Python implementation of SWEM (Simple Word-Embedding-based Methods)☆30Jun 21, 2022Updated 3 years ago
- hottoSNS-w2v: 日本語大規模SNS+Webコーパスによる単語分散表現モデル☆61Dec 4, 2024Updated last year
- BERT models for Japanese text.☆544Mar 23, 2024Updated last year
- BERT with SentencePiece for Japanese text.☆498Feb 15, 2021Updated 5 years ago
- A tool for building gensim word2vec model for Japanese.☆93Feb 20, 2017Updated 9 years ago
- script to evaluate pre-trained Japanese word2vec model on Japanese similarity dataset☆12Nov 4, 2024Updated last year
- Utility scripts for preprocessing Wikipedia texts for NLP☆78Apr 9, 2024Updated last year
- Neologism dictionary based on the language resources on the Web for mecab-ipadic☆2,788Dec 27, 2023Updated 2 years ago
- JGLUE: Japanese General Language Understanding Evaluation☆337Mar 31, 2025Updated 11 months ago
- A Japanese NLP Library using spaCy as framework based on Universal Dependencies☆832Mar 30, 2024Updated last year
- Python Implementation of EmbedRank☆48Mar 19, 2019Updated 6 years ago
- Use custom tokenizers in spacy-transformers☆16Aug 9, 2022Updated 3 years ago
- ☆15Sep 3, 2019Updated 6 years ago
- ☆35Aug 20, 2020Updated 5 years ago
- Codes to pre-train Japanese T5 models☆40Sep 7, 2021Updated 4 years ago
- Japanese BERT trained on Aozora Bunko and Wikipedia, pre-tokenized by MeCab with UniDic & SudachiPy☆40Aug 8, 2020Updated 5 years ago
- おーぷん2ちゃんねるをクロールして作成した対話コーパス☆99Jun 6, 2021Updated 4 years ago
- ☆11Aug 12, 2020Updated 5 years ago
- Document Environment for spiegel-im-spiegel.github.io☆10Feb 26, 2026Updated last week
- SCDV : Sparse Composite Document Vectors using soft clustering over distributional representations☆10Jan 28, 2019Updated 7 years ago
- 日本語文法誤り訂正 ツール☆29Jun 22, 2022Updated 3 years ago
- Code for evaluating Japanese pretrained models provided by NTT Ltd.☆245Jun 21, 2023Updated 2 years ago
- Japanese text8 corpus for word embedding.☆111Oct 4, 2017Updated 8 years ago
- natto-py combines the Python programming language with MeCab, the part-of-speech and morphological analyzer for the Japanese language.☆95Jun 6, 2024Updated last year
- ☆12Jan 22, 2020Updated 6 years ago
- Deliver the ready-to-train data to your NLP model.☆122Jul 15, 2022Updated 3 years ago
- hottoSNS-BERT: 大規模SNSコーパスによる文分散表現モデル☆62Jan 22, 2026Updated last month
- ☆161Oct 19, 2020Updated 5 years ago
- Sentence boundary disambiguation tool for Japanese texts (日本語文境界判定器)☆199Mar 26, 2024Updated last year
- Kyoto University Web Document Leads Corpus☆83Dec 18, 2023Updated 2 years ago
- match function that match token(形態素解析) with sentence.☆14Aug 23, 2022Updated 3 years ago
- Discovering Universal Geometry in Embeddings with ICA (Published in EMNLP 2023)☆20Jun 17, 2025Updated 8 months ago
- 🐎 Colt: Effortlessly configure and construct Python objects with colt, a lightweight library inspired by AllenNLP and Tango☆26Dec 6, 2025Updated 2 months ago
- ☆100Jul 23, 2023Updated 2 years ago
- Japanese Realistic Textual Entailment Corpus (NLP 2020, LREC 2020)☆77Jun 23, 2023Updated 2 years ago