Alternatives and similar repositories for polyglot

Users that are interested in polyglot are comparing it to the libraries listed below

• tunib-ai / large-scale-lm-tutorials
  Large-scale language modeling tutorials with PyTorch
  ☆289Updated 3 years ago
• davidkim205 / komt
  Korean Multi-task Instruction Tuning
  ☆159Updated last year
• AIRC-KETI / ke-t5
  ☆196Updated 2 years ago
• EleutherAI / dps
  Data processing system for polyglot
  ☆91Updated last year
• kakaobrain / kor-nlu-datasets
  KorNLI and KorSTS: New Benchmark Datasets for Korean Natural Language Understanding
  ☆306Updated last year
• BM-K / Sentence-Embedding-Is-All-You-Need
  Korean Sentence Embedding Repository
  ☆208Updated 6 months ago
• jaketae / koclip
  KoCLIP: Korean port of OpenAI CLIP, in Flax
  ☆152Updated last year
• lassl / lassl
  Easy Language Model Pretraining leveraging Huggingface's Transformers and Datasets
  ☆129Updated 2 years ago
• ko-nlp / Open-korean-corpora
  Open Korean NLP Dataset Curation for the Users All Around the Globe
  ☆148Updated last year
• Marker-Inc-Korea / KO-Platypus
  [KO-Platy🥮] Korean-Open-platypus를 활용하여 llama-2-ko를 fine-tuning한 KO-platypus model
  ☆75Updated last year
• monologg / KoBigBird
  🦅 Pretrained BigBird Model for Korean (up to 4096 tokens)
  ☆202Updated last year
• sooftware / Korean-PLM
  List of Korean pre-trained language models.
  ☆185Updated last year
• cosmoquester / 2021-dialogue-summary-competition
  [2021 훈민정음 한국어 음성•자연어 인공지능 경진대회] 대화요약 부문 알라꿍달라꿍 팀의 대화요약 학습 및 추론 코드를 공유하기 위한 레포입니다.
  ☆128Updated 2 years ago
• airobotlab / KoChatGPT
  ChatGPT의 RLHF를 학습을 위한 3가지 step별 한국어 데이터셋
  ☆34Updated last year
• krafton-ai / KORani
  ☆106Updated 2 years ago
• HAE-RAE / HAE-RAE-BENCH
  Benchmark in Korean Context
  ☆131Updated last year
• hyunwoongko / pecab
  Pecab: Pure python Korean morpheme analyzer based on Mecab
  ☆167Updated last year
• kakaobrain / kortok
  The code and models for "An Empirical Study of Tokenization Strategies for Various Korean NLP Tasks" (AACL-IJCNLP 2020)
  ☆118Updated 4 years ago
• Beomi / easy-lm-trainer
  🤗 최소한의 세팅으로 LM을 학습하기 위한 샘플코드
  ☆58Updated 2 years ago
• HeegyuKim / open-korean-instructions
  언어모델을 학습하기 위한 공개 한국어 instruction dataset들을 모아두었습니다.
  ☆419Updated last month
• Marker-Inc-Korea / K-G-OAT
  IA3방식으로 KoAlpaca를 fine tuning한 한국어 LLM모델
  ☆68Updated last year
• tabtoyou / KoLLaVA
  KoLLaVA: Korean Large Language-and-Vision Assistant (feat.LLaVA)
  ☆291Updated 8 months ago
• kiyoungkim1 / LMkor
  Pretrained Language Models for Korean
  ☆393Updated 2 years ago
• tunib-ai / tunib-electra
  Korean-English Bilingual Electra Models
  ☆110Updated 3 years ago
• snunlp / KR-BERT
  KoRean based BERT pre-trained models (KR-BERT) for Tensorflow and PyTorch
  ☆208Updated last year
• naver-ai / korean-safety-benchmarks
  Official datasets and pytorch implementation repository of SQuARe and KoSBi (ACL 2023)
  ☆242Updated last year
• UpstageAI / evalverse
  The Universe of Evaluation. All about the evaluation for LLMs.
  ☆224Updated 10 months ago
• monologg / KoBERT-Transformers
  KoBERT on 🤗 Huggingface Transformers 🤗 (with Bug Fixed)
  ☆211Updated 9 months ago
• snunlp / KR-SBERT
  KoRean based SBERT pre-trained models (KR-SBERT) for PyTorch
  ☆98Updated 3 years ago
• KLUE-benchmark / KLUE
  📖 Korean NLU Benchmark
  ☆572Updated 2 years ago