EleutherAI / polyglot
Polyglot: Large Language Models of Well-balanced Competence in Multi-languages
☆480Updated last year
Alternatives and similar repositories for polyglot:
Users that are interested in polyglot are comparing it to the libraries listed below
- Large-scale language modeling tutorials with PyTorch☆290Updated 3 years ago
- Data processing system for polyglot☆91Updated last year
- Korean Multi-task Instruction Tuning☆157Updated last year
- ☆195Updated last year
- KoCLIP: Korean port of OpenAI CLIP, in Flax☆149Updated last year
- Korean Sentence Embedding Repository☆208Updated 4 months ago
- Easy Language Model Pretraining leveraging Huggingface's Transformers and Datasets☆129Updated 2 years ago
- Official datasets and pytorch implementation repository of SQuARe and KoSBi (ACL 2023)☆242Updated last year
- KorNLI and KorSTS: New Benchmark Datasets for Korean Natural Language Understanding☆304Updated last year
- 🦅 Pretrained BigBird Model for Korean (up to 4096 tokens)☆203Updated last year
- ChatGPT의 RLHF를 학습을 위한 3가지 step별 한국어 데이터셋☆32Updated last year
- [KO-Platy🥮] Korean-Open-platypus를 활용하여 llama-2-ko를 fine-tuning한 KO-platypus model☆75Updated last year
- 언어모델을 학습하기 위한 공개 한국어 instruction dataset들을 모아두었습니다.☆401Updated last month
- ☆105Updated last year
- [2021 훈민정음 한국어 음성•자연어 인공지능 경진대회] 대화요약 부문 알라꿍달라꿍 팀의 대화요약 학습 및 추론 코드를 공유하기 위한 레포입니다.☆127Updated 2 years ago
- 🤗 최소한의 세팅으로 LM을 학습하기 위한 샘플코드☆58Updated last year
- Open Korean NLP Dataset Curation for the Users All Around the Globe☆146Updated last year
- Awesome list of Korean Large Language Models.☆463Updated last year
- Curation note of NLP datasets☆96Updated 2 years ago
- [Google Meet] MLLM Arxiv Casual Talk☆52Updated 2 years ago
- evolve llm training instruction, from english instruction to any language.☆115Updated last year
- IA3방식으로 KoAlpaca를 fine tuning한 한국어 LLM모델☆68Updated last year
- Benchmark in Korean Context☆130Updated last year
- Pecab: Pure python Korean morpheme analyzer based on Mecab☆161Updated 11 months ago
- OSLO: Open Source for Large-scale Optimization☆175Updated last year
- Forked repo from https://github.com/EleutherAI/lm-evaluation-harness/commit/1f66adc☆76Updated last year
- This repo Implements "Dense Passage Retrieval for Open-Domain Question Answering" using Korean Dataset☆75Updated 2 years ago
- OSLO: Open Source framework for Large-scale model Optimization☆308Updated 2 years ago
- 📖 Korean NLU Benchmark☆565Updated 2 years ago
- List of Korean pre-trained language models.☆186Updated last year