hppRC / llm-translator
Mixtral-based Ja-En (En-Ja) Translation model
☆19Updated 2 months ago
Alternatives and similar repositories for llm-translator:
Users that are interested in llm-translator are comparing it to the libraries listed below
- ☆25Updated 4 months ago
- Japanese LLaMa experiment☆53Updated 3 months ago
- ☆125Updated last month
- ☆83Updated last year
- Swallowプロジェクト 大規模言語モデル 評価スクリプト☆16Updated last week
- ☆59Updated 9 months ago
- Japanese instruction data (日本語指示データ)☆22Updated last year
- 【2024年版】BERT によるテキスト分類☆29Updated 8 months ago
- Preferred Generation Benchmark☆78Updated 2 weeks ago
- ☆50Updated last year
- ☆14Updated 6 months ago
- ☆17Updated last year
- RealPersonaChat: A Realistic Persona Chat Corpus with Interlocutors' Own Personalities☆53Updated last year
- JMultiWOZ: A Large-Scale Japanese Multi-Domain Task-Oriented Dialogue Dataset, LREC-COLING 2024☆23Updated last year
- Japanese-BPEEncoder☆41Updated 3 years ago
- Official implementation of "TAID: Temporally Adaptive Interpolated Distillation for Efficient Knowledge Transfer in Language Models"☆98Updated last month
- ☆34Updated 5 years ago
- The robust text processing pipeline framework enabling customizable, efficient, and metric-logged text preprocessing.☆121Updated 4 months ago
- Utility scripts for preprocessing Wikipedia texts for NLP☆76Updated 11 months ago
- Easily turn large English text datasets into Japanese text datasets using open LLMs.☆20Updated 2 months ago
- 日本語マルチタスク言語理解ベンチマーク Japanese Massive Multitask Language Understanding Benchmark☆33Updated 3 months ago
- ☆22Updated last year
- The evaluation scripts of JMTEB (Japanese Massive Text Embedding Benchmark)☆52Updated 3 weeks ago
- Unofficial entropix impl for Gemma2 and Llama and Qwen2 and Mistral☆17Updated 2 months ago
- ☆15Updated last year
- This repository has implementations of data augmentation for NLP for Japanese.☆64Updated 2 years ago
- LEIA: Facilitating Cross-Lingual Knowledge Transfer in Language Models with Entity-based Data Augmentation☆21Updated 11 months ago
- ☆18Updated 10 months ago
- COMET-ATOMIC ja☆29Updated last year
- Code for COLING 2020 Paper☆13Updated 3 weeks ago