HeegyuKim / language-model
한국어 언어 모델 학습을 위한 프로젝트(Flax, Pytorch with Huggingface Accelerate)
☆32Updated last year
Alternatives and similar repositories for language-model:
Users that are interested in language-model are comparing it to the libraries listed below
- bpe based korean t5 model for text-to-text unified framework☆63Updated 11 months ago
- 🤗 최소한의 세팅으로 LM을 학습하기 위한 샘플코드☆58Updated last year
- ☆19Updated 4 years ago
- StrategyQA 데이터 세트 번역☆22Updated 11 months ago
- Adversarial Test Dataset for Korean Multi-turn Response Selection☆34Updated 3 years ago
- 한국어 자연어 처리 모델 미세조정☆16Updated 4 years ago
- 한국어 LLM 리더보드 및 모델 성능/안전성 관리☆22Updated last year
- Korean Math Word Problems☆58Updated 3 years ago
- 한국어 T5 모델☆51Updated 3 years ago
- Dataset of Korean Threatening Conversations☆70Updated 2 years ago
- 한국어 노이즈 생성을 위한 라이브러리입니다.☆22Updated last year
- This repository contains Korean Hate Speech dataset for paper, "K-MHaS: A Multi-label Hate Speech Detection Dataset in Korean Online News…☆43Updated 10 months ago
- ☆34Updated last year
- ☆20Updated last year
- KoBART chatbot☆47Updated 3 years ago
- [Findings of NAACL2022] A Dog Is Passing Over The Jet? A Text-Generation Dataset for Korean Commonsense Reasoning and Evaluation☆28Updated 2 years ago
- For the rlhf learning environment of Koreans☆23Updated last year
- Opensource chatbot framework☆16Updated 3 years ago
- Wikitext format dataset of Namuwiki (Most famous Korean wikipedia)☆51Updated 4 years ago
- Bias, Hate classification with KoELECTRA 👿☆27Updated last year
- Reward Model을 이용하여 언어모델의 답변을 평가하기☆27Updated last year
- State-of-the-art Retrieval Model implementing "Dense Passage Retrieval for Open-Domain Question Answering" with Korean Dataset.☆9Updated 2 years ago
- T5-base model for Korean☆26Updated 3 years ago
- ☆32Updated last year
- ☆14Updated 3 years ago
- 한국어 생성 모델의 상식 추론을 위한 KommonGen 데이터셋입니다.☆17Updated 3 years ago
- Parallel dataset of Korean Questions and Commands☆60Updated 2 years ago
- kogpt를 oslo로 파인튜닝하는 예제.☆23Updated 2 years ago
- Character-level Korean ELECTRA Model (음절 단위 한국어 ELECTRA)☆54Updated last year
- A utility for storing and reading files for Korean LM training 💾☆37Updated last year