llm-jp / text2datasetLinks
Easily turn large English text datasets into Japanese text datasets using open LLMs.
☆20Updated 4 months ago
Alternatives and similar repositories for text2dataset
Users that are interested in text2dataset are comparing it to the libraries listed below
Sorting:
- ☆83Updated last year
- Preferred Generation Benchmark☆82Updated last week
- 【2024年版】BERTによるテキスト分類☆29Updated 10 months ago
- ☆60Updated 11 months ago
- ☆26Updated 7 months ago
- ☆50Updated last year
- JMultiWOZ: A Large-Scale Japanese Multi-Domain Task-Oriented Dialogue Dataset, LREC-COLING 2024☆24Updated last year
- Japanese-BPEEncoder☆41Updated 3 years ago
- Mixtral-based Ja-En (En-Ja) Translation model☆19Updated 5 months ago
- ☆20Updated 4 months ago
- ☆51Updated 11 months ago
- Japanese LLaMa experiment☆52Updated 5 months ago
- ☆24Updated last year
- Swallowプロジェクト 大規模言語モデル 評価スクリプト☆17Updated last month
- The evaluation scripts of JMTEB (Japanese Massive Text Embedding Benchmark)☆60Updated last month
- Viterbi-based accelerated tokenizer (Python wrapper)☆42Updated 9 months ago
- ☆16Updated last year
- Exploring Japanese SimCSE☆68Updated last year
- ☆15Updated last year
- デジタル化資料OCRテキスト化事業において作成されたOCR学習用データセット☆74Updated 11 months ago
- ☆55Updated 3 months ago
- JQaRA: Japanese Question Answering with Retrieval Augmentation - 検索拡張(RAG)評価のための日本語Q&Aデータセット☆30Updated 4 months ago
- Japanese instruction data (日本語指示データ)☆24Updated last year
- ☆47Updated 5 months ago
- ☆34Updated 5 years ago
- ☆132Updated this week
- 生成自動評価を行うためのPythonツール☆24Updated last month
- A lightweight framework for evaluating visual-language models.☆29Updated 2 weeks ago
- NLP 100 Exercise 2025☆22Updated last month
- DistilBERT model pre-trained on 131 GB of Japanese web text. The teacher model is BERT-base that built in-house at LINE.☆44Updated 2 years ago