speed1313 / jax-llmLinks
JAX implementation of Large Language Models. You can train GPT-2-like model with 青空文庫 (aozora bunko-clean dataset) or any other text dataset.
☆13Updated 10 months ago
Alternatives and similar repositories for jax-llm
Users that are interested in jax-llm are comparing it to the libraries listed below
Sorting:
- Easily turn large English text datasets into Japanese text datasets using open LLMs.☆20Updated 4 months ago
- ☆26Updated 7 months ago
- JMultiWOZ: A Large-Scale Japanese Multi-Domain Task-Oriented Dialogue Dataset, LREC-COLING 2024☆24Updated last year
- ☆16Updated last year
- Code for COLING 2020 Paper☆13Updated this week
- 敬語変換タスクにおける評価用データセット☆21Updated 2 years ago
- 1st place solution of 🦾😢 in https://www.kaggle.com/c/ai-medical-contest-2021/☆10Updated 4 years ago
- Swallowプロジェクト 大規模言語モデル 評価スクリプト☆17Updated last month
- ☆47Updated 5 months ago
- ☆34Updated 5 years ago
- Japanese-BPEEncoder☆41Updated 3 years ago
- Training and evaluation scripts for JGLUE, a Japanese language understanding benchmark☆17Updated this week
- Preferred Generation Benchmark☆82Updated 2 weeks ago
- Japanese instruction data (日本語指示データ)☆24Updated last year
- 日経Linux2023年9月号LLM特集のリポジトリ☆9Updated last year
- ☆23Updated last week
- ☆20Updated 4 months ago
- 『アルゴリズムとデータ構造』(大槻兼資著、秋葉拓哉監修; 講談社)という本を Python で書き直しているプロジェクトです。☆20Updated 2 years ago
- ☆19Updated last year
- 【2024年版】BERTによるテキスト分類☆29Updated 11 months ago
- Mecab + NEologd + Docker + Python3☆35Updated 3 years ago
- Show notes for https://anchor.fm/yoheikikuta.☆15Updated 3 years ago
- ☆17Updated last year
- ☆11Updated last week
- 2023年度未踏IT人材発掘・育成事業芝山PJの関連書類☆14Updated last year
- ☆50Updated last year
- ☆11Updated 5 years ago
- A lightweight framework for evaluating visual-language models.☆29Updated 2 weeks ago
- NLP 100 Exercise 2025☆23Updated last month
- meta-heuristics solver for easy modeling☆31Updated 2 years ago