llm-jp / text2dataset
Easily turn large English text datasets into Japanese text datasets using open LLMs.
☆13Updated 2 weeks ago
Related projects ⓘ
Alternatives and complementary repositories for text2dataset
- ☆34Updated 5 years ago
- 【2024年版】BERTによるテキスト分類☆24Updated 4 months ago
- Mecab + NEologd + Docker + Python3☆35Updated 2 years ago
- Exploring Japanese SimCSE☆62Updated last year
- JMultiWOZ: A Large-Scale Japanese Multi-Domain Task-Oriented Dialogue Dataset☆22Updated 7 months ago
- ☆82Updated last year
- ☆29Updated last month
- NLP2024 チュートリアル３ 作って学ぶ日本 語大規模言語モデル - 環境構築手順とソースコード / NLP2024 Tutorial 3: Practicing how to build a Japanese large-scale language model - E…☆107Updated 7 months ago
- ☆50Updated last year
- ☆18Updated 2 weeks ago
- ☆52Updated 4 months ago
- FlexGen with docker☆28Updated last year
- Mixtral-based Ja-En (En-Ja) Translation model☆16Updated 10 months ago
- Japanese instruction data (日本語指示データ)☆22Updated last year
- GPTがYouTuberをやります☆62Updated 10 months ago
- Japanese translation for book about interpretable machine learning by Christoph Molnar. Main branch is `japanese` branch not `master` bra…☆60Updated 3 years ago
- ☆15Updated 8 months ago
- ☆31Updated 3 months ago
- alpacaデータセットを日本語化したものです☆89Updated last year
- ☆24Updated last week
- ☆15Updated 11 months ago
- ☆25Updated 5 months ago
- DeepLearningのAttentionモデルをPytorchの低レベルAPIを使って1から制作しようという試みのリポジトリです。☆40Updated last year
- Japanese synonym library☆52Updated 2 years ago
- 🛥 Vaporetto is a fast and lightweight pointwise prediction based tokenizer. This is a Python wrapper for Vaporetto.☆20Updated 2 months ago
- Japanese-BPEEncoder☆39Updated 3 years ago
- ☆22Updated 10 months ago
- JQaRA: Japanese Question Answering with Retrieval Augmentation - 検索拡張(RAG)評価のための日本語Q&Aデータセット☆23Updated last month
- ☆33Updated last year
- Pretrained models, codes and guidances to pretrain official ALBERT(https://github.com/google-research/albert) on Japanese Wikipedia☆12Updated last year