Stability-AI / lm-evaluation-harness
A framework for few-shot evaluation of autoregressive language models.
☆145Updated 2 months ago
Related projects ⓘ
Alternatives and complementary repositories for lm-evaluation-harness
- LLMとLoRAを用いたテキスト分類☆93Updated last year
- ☆82Updated last year
- Exploring Japanese SimCSE☆62Updated last year
- ☆101Updated this week
- The robust text processing pipeline framework enabling customizable, efficient, and metric-logged text preprocessing.☆118Updated 3 weeks ago
- ☆168Updated last month
- alpacaデータセットを日本語化したものです☆89Updated last year
- ☆164Updated 5 months ago
- Japanese LLaMa experiment☆52Updated 8 months ago
- ☆51Updated 5 months ago
- ☆142Updated last year
- ☆52Updated 5 months ago
- JGLUE: Japanese General Language Understanding Evaluation☆305Updated last month
- NLP2024 チュートリアル3 作って学ぶ日本語大規模言語モデル - 環境構築手順とソースコード / NLP2024 Tutorial 3: Practicing how to build a Japanese large-scale language model - E…☆107Updated 7 months ago
- Japanese Language Model Financial Evaluation Harness☆65Updated 3 weeks ago
- Japanese instruction data (日本語指示データ)☆22Updated last year
- General-purpose Swich transformer based Japanese language model☆117Updated last year
- 日本語T5モデル☆113Updated 2 months ago
- LLM構築用の日本語チャットデータセット☆78Updated 9 months ago
- RealPersonaChat: A Realistic Persona Chat Corpus with Interlocutors' Own Personalities☆48Updated 8 months ago
- JMultiWOZ: A Large-Scale Japanese Multi-Domain Task-Oriented Dialogue Dataset☆22Updated 7 months ago
- ☆50Updated last year
- ☆22Updated 11 months ago
- ☆14Updated 2 months ago
- ☆20Updated last year
- JMED-LLM: Japanese Medical Evaluation Dataset for Large Language Models☆43Updated 2 months ago
- 【2023年版】BERTによるテキスト分類☆227Updated 5 months ago
- 【2024年版】BERTによるテキスト分類☆24Updated 4 months ago
- The Remdis toolkit: Building advanced real-time multimodal dialogue systems with incremental processing and large language models☆77Updated last month
- DeepLearningのAttentionモデルをPytorchの低レベルAPIを使って1から制作しようという試みのリポジトリです。☆43Updated last year