izuna385 / Wikia-and-Wikipedia-EL-Dataset-Creator
You can create datasets from Wikia/Wikipedia that can be used for entity recognition and Entity Linking. Dumps for ja-wiki and VTuber-wiki are available!
☆17Updated 3 years ago
Alternatives and similar repositories for Wikia-and-Wikipedia-EL-Dataset-Creator:
Users that are interested in Wikia-and-Wikipedia-EL-Dataset-Creator are comparing it to the libraries listed below
- Utility scripts for preprocessing Wikipedia texts for NLP☆76Updated 11 months ago
- Japanese Entity Linker.☆11Updated 3 years ago
- ☯️ AllenNLP training configurations for promising models on Named Entity Recognition. (BiLSTM-CRF, BiLSTM-CNN-CRF, BERT, BERT-CRF)☆15Updated 4 years ago
- 日本語テキストに対する wikification のためのソフトウェア☆15Updated 8 years ago
- ☆11Updated 3 years ago
- ⚡️ AllenNLP plugin for adding subcommands to use Optuna, making hyperparameter optimization easy☆33Updated 3 years ago
- ☆25Updated 2 weeks ago
- Code for COLING 2020 Paper☆13Updated 3 weeks ago
- Japanese data from the Google UDT 2.0.☆28Updated 2 years ago
- ☆9Updated 2 years ago
- DIRECT: Direct and Indirect REsponses in Conversational Text Corpus☆16Updated 3 years ago
- Annotated Fuman Kaitori Center Corpus☆17Updated last year
- Funer is Rule based Named Entity Recognition tool.☆22Updated 2 years ago
- Zero-shot Entity Linking with blitz start in 3 minutes. Hard negative mining and encoder for all entities are also included in this imple…☆31Updated last year
- ☆18Updated 10 months ago
- Use custom tokenizers in spacy-transformers☆16Updated 2 years ago
- AllenNLP integration for Shiba: Japanese CANINE model☆12Updated 3 years ago
- ☆17Updated last year
- Python implementation of "Data-dependent Learning of Symmetric/Antisymmetric Relations for Knowledge Base Completion [Manabe+. 2018]"☆11Updated 7 years ago
- Repository for JSICK☆44Updated last year
- A library for semantic similarity search☆24Updated 2 months ago
- Coursera Corpus Mining and Multistage Fine-Tuning for Improving Lectures Translation☆14Updated 7 months ago
- Codes to pre-train Japanese T5 models☆41Updated 3 years ago
- Entitypedia is an Extended Named Entity Dictionary from Wikipedia.☆13Updated 2 years ago
- ☆10Updated 2 years ago
- SciWING is a modern toolkit for scientific document processing from WING-NUS☆63Updated last year
- Evidence-based Explanation Dataset (AACL-IJCNLP 2020)☆18Updated 4 years ago
- https://www.nlp.ecei.tohoku.ac.jp/projects/aio/☆16Updated 2 years ago
- X-SCITLDR: Cross-Lingual Extreme Summarization of Scholarly Documents (JCDL 2022)☆14Updated 2 years ago
- Trials of pre-trained BERT models for the medical domain in Japanese.☆12Updated 4 years ago