Alternatives and similar repositories for polyglot

Users that are interested in polyglot are comparing it to the libraries listed below

• EleutherAI / dps
  Data processing system for polyglot
  ☆92Updated 2 years ago
• davidkim205 / komt
  Korean Multi-task Instruction Tuning
  ☆158Updated last year
• AIRC-KETI / ke-t5
  ☆197Updated 2 years ago
• krafton-ai / KORani
  ☆107Updated 2 years ago
• tunib-ai / large-scale-lm-tutorials
  Large-scale language modeling tutorials with PyTorch
  ☆291Updated 3 years ago
• Marker-Inc-Korea / KO-Platypus
  [KO-Platy🥮] Korean-Open-platypus를 활용하여 llama-2-ko를 fine-tuning한 KO-platypus model
  ☆75Updated last week
• Marker-Inc-Korea / K-G-OAT
  IA3방식으로 KoAlpaca를 fine tuning한 한국어 LLM모델
  ☆69Updated 2 years ago
• BM-K / Sentence-Embedding-Is-All-You-Need
  Korean Sentence Embedding Repository
  ☆210Updated 9 months ago
• jaketae / koclip
  KoCLIP: Korean port of OpenAI CLIP, in Flax
  ☆155Updated 2 years ago
• melodysdreamj / KoVicuna
  ☆123Updated 2 years ago
• lassl / lassl
  Easy Language Model Pretraining leveraging Huggingface's Transformers and Datasets
  ☆130Updated 2 years ago
• Beomi / Gemma-EasyLM
  Train GEMMA on TPU/GPU! (Codebase for training Gemma-Ko Series)
  ☆48Updated last year
• HAE-RAE / HAE-RAE-BENCH
  Benchmark in Korean Context
  ☆136Updated last year
• sooftware / Korean-PLM
  List of Korean pre-trained language models.
  ☆187Updated 2 years ago
• Beomi / easy-lm-trainer
  🤗 최소한의 세팅으로 LM을 학습하기 위한 샘플코드
  ☆58Updated 2 years ago
• hyunwoongko / nlp-datasets
  Curation note of NLP datasets
  ☆97Updated 2 years ago
• naver-ai / korean-safety-benchmarks
  Official datasets and pytorch implementation repository of SQuARe and KoSBi (ACL 2023)
  ☆244Updated 2 years ago
• ko-nlp / Open-korean-corpora
  Open Korean NLP Dataset Curation for the Users All Around the Globe
  ☆152Updated last year
• Beomi / ko-lm-evaluation-harness
  Forked repo from https://github.com/EleutherAI/lm-evaluation-harness/commit/1f66adc
  ☆80Updated last year
• tunib-ai / KMWP
  Korean Math Word Problems
  ☆59Updated 3 years ago
• gyunggyung / MLLMArxivTalk
  [Google Meet] MLLM Arxiv Casual Talk
  ☆52Updated 2 years ago
• kakaobrain / kor-nlu-datasets
  KorNLI and KorSTS: New Benchmark Datasets for Korean Natural Language Understanding
  ☆309Updated 2 years ago
• paust-team / pko-t5
  bpe based korean t5 model for text-to-text unified framework
  ☆63Updated last year
• hyunwoongko / pecab
  Pecab: Pure python Korean morpheme analyzer based on Mecab
  ☆171Updated last year
• jskwak98 / Bookathon3_Bookie_On_And_On
  ☆31Updated last year
• quantumaikr / KoreanLM
  한국어 언어모델 오픈소스
  ☆82Updated 2 years ago
• smilegate-ai / korean_smile_style_dataset
  ☆147Updated 3 years ago
• HeegyuKim / open-korean-instructions
  언어모델을 학습하기 위한 공개 한국어 instruction dataset들을 모아두었습니다.
  ☆434Updated 4 months ago
• monologg / KoBigBird
  🦅 Pretrained BigBird Model for Korean (up to 4096 tokens)
  ☆202Updated last year
• snunlp / KR-SBERT
  KoRean based SBERT pre-trained models (KR-SBERT) for PyTorch
  ☆100Updated 3 years ago