EleutherAI / polyglot
Polyglot: Large Language Models of Well-balanced Competence in Multi-languages
☆469Updated last year
Related projects: ⓘ
- Large-scale language modeling tutorials with PyTorch☆284Updated 2 years ago
- Korean Multi-task Instruction Tuning☆156Updated 9 months ago
- 언어모델을 학습하기 위한 공개 한국어 instruction dataset들을 모아두었습니다.☆334Updated last month
- OSLO: Open Source framework for Large-scale model Optimization☆306Updated 2 years ago
- Korean Sentence Embedding Repository☆198Updated 7 months ago
- ☆191Updated last year
- Official datasets and pytorch implementation repository of SQuARe and KoSBi (ACL 2023)☆233Updated last year
- KoLLaVA: Korean Large Language-and-Vision Assistant (feat.LLaVA)☆259Updated 3 months ago
- Data processing system for polyglot☆88Updated last year
- KoCLIP: Korean port of OpenAI CLIP, in Flax☆142Updated last year
- ChatGPT의 RLHF를 학습을 위한 3가지 step별 한국어 데이터셋☆26Updated 10 months ago
- Easy Language Model Pretraining leveraging Huggingface's Transformers and Datasets☆127Updated last year
- 🥤🧑🏻🚀Code and dataset for our EMNLP 2023 paper - "SODA: Million-scale Dialogue Distillation with Social Commonsense Contextualization…☆218Updated 8 months ago
- KorNLI and KorSTS: New Benchmark Datasets for Korean Natural Language Understanding☆298Updated last year
- List of Korean pre-trained language models.☆187Updated last year
- OSLO: Open Source for Large-scale Optimization☆172Updated last year
- KSS: Korean String processing Suite☆413Updated 3 months ago
- Awesome list of Korean Large Language Models.☆434Updated 10 months ago
- [KO-Platy🥮] Korean-Open-platypus를 활용하여 llama-2-ko를 fine-tuning한 KO-platypus model☆77Updated 10 months ago
- Open Korean NLP Dataset Curation for the Users All Around the Globe☆136Updated 10 months ago
- Benchmark in Korean Context☆123Updated 11 months ago
- 📖 Korean NLU Benchmark☆558Updated 2 years ago
- 한국어 언어모델 다분야 사고력 벤치마크☆148Updated this week
- Pecab: Pure python Korean morpheme analyzer based on Mecab☆155Updated 4 months ago
- Pretrained Language Models for Korean☆389Updated last year
- The Universe of Evaluation. All about the evaluation for LLMs.☆205Updated 2 months ago
- IA3방식으로 KoAlpaca를 fine tuning한 한국어 LLM모델☆67Updated last year
- [2021 훈민정음 한국어 음성•자연어 인공지능 경진대회] 대화요약 부문 알라꿍달라꿍 팀의 대화요약 학습 및 추론 코드를 공유하기 위한 레포입니다.☆126Updated 2 years ago
- 한국어 사전학습 모델을 활용한 문장 임베딩☆165Updated last year
- Instruct-tune LLaMA on consumer hardware☆15Updated last year