singletongue / wikipedia-utilsLinks
Utility scripts for preprocessing Wikipedia texts for NLP
☆77Updated last year
Alternatives and similar repositories for wikipedia-utils
Users that are interested in wikipedia-utils are comparing it to the libraries listed below
Sorting:
- ☆28Updated 6 months ago
- The robust text processing pipeline framework enabling customizable, efficient, and metric-logged text preprocessing.☆123Updated 2 weeks ago
- Repository for JSICK☆44Updated 2 years ago
- Codes to pre-train Japanese T5 models☆40Updated 4 years ago
- This repository has implementations of data augmentation for NLP for Japanese.☆64Updated 2 years ago
- Code for COLING 2020 Paper☆13Updated 2 weeks ago
- Flexible evaluation tool for language models☆52Updated 2 weeks ago
- A simple implementation of SimCSE☆77Updated 2 years ago
- 日本語マルチタスク言語理解ベンチマーク Japanese Massive Multitask Language Understanding Benchmark☆36Updated 2 weeks ago