Alternatives and similar repositories for Compare-tokenizer:

Users that are interested in Compare-tokenizer are comparing it to the libraries listed below

• monologg / ko_lm_dataformat
  A utility for storing and reading files for Korean LM training 💾
  ☆37Updated last year
• hkjeon13 / noising-korean
  한국어 문서에 노이즈를 추가합니다.
  ☆27Updated 2 years ago
• inmoonlight / yajatime
  야자타임 (a.k.a. 야밤의 자연어처리 타임)
  ☆27Updated 3 years ago
• snoop2head / KLUE-RBERT
  ↔️ Utilizing RBERT model structure for KLUE Relation Extraction task
  ☆15Updated 2 years ago
• kakaoenterprise / KorAdvMRSTestData
  Adversarial Test Dataset for Korean Multi-turn Response Selection
  ☆34Updated 3 years ago
• monologg / KoELECTRA-Pipeline
  Transformers Pipeline with KoELECTRA
  ☆40Updated last year
• seujung / t5-summarization
  ☆26Updated 4 years ago
• MrBananaHuman / KalBert
  Korean ALBERT
  ☆47Updated 5 years ago
• soeque1 / KoGPT2-DINO
  ☆20Updated 2 years ago
• seujung / kolang-t5-base
  T5-base model for Korean
  ☆26Updated 3 years ago
• lovit / petitions_archive
  청와대 국민청원 데이터 아카이브
  ☆15Updated 4 years ago
• monologg / kakaotrans
  [Unofficial] Kakaotrans: Kakao translate API for python
  ☆16Updated 4 years ago
• Ronalmoo / fewshot_torch
  ☆18Updated 2 years ago
• jason9693 / oslo-kogpt-finetunig
  kogpt를 oslo로 파인튜닝하는 예제.
  ☆23Updated 2 years ago
• BM-K / Styling-Chatbot-with-Transformer
  Language Style과 감정에 따른 챗봇 답변 변화 모델
  ☆33Updated 3 years ago
• hyunwoongko / kobart-transformers
  Kobart model on Huggingface transformers
  ☆63Updated 3 years ago
• ModuNLP / weekly-meeting
  매주 목요일, 20:00 모임
  ☆16Updated 4 years ago
• lovit / huggingface_konlpy
  Training Transformers of Huggingface with KoNLPy
  ☆68Updated 4 years ago
• korean-named-entity / konne
  Korean Nested Named Entity Corpus
  ☆18Updated last year
• modulabs / beyondBERT
  11.5기의 beyondBERT의 토론 내용을 정리하는 repository입니다.
  ☆59Updated 4 years ago
• MrBananaHuman / KoGPT2ForParaphrasing
  TEMP
  ☆34Updated 4 years ago
• lovit / levenshtein_finder
  Similar string search in Levenshtein distance
  ☆21Updated 3 years ago
• lih0905 / WSD_kor
  한국어 어휘 의미 분석 모델
  ☆21Updated 2 years ago
• monologg / KoCharELECTRA
  Character-level Korean ELECTRA Model (음절 단위 한국어 ELECTRA)
  ☆54Updated last year
• lyeoni / KorQuAD
  KorQuAD (Korean Question Answering Dataset) submission guide using PyTorch pretrained BERT
  ☆31Updated 5 years ago
• korean-named-entity / konec
  Korean Named Entity Corpus
  ☆25Updated last year
• nawnoes / NamuwikiExtractor
  나무위키덤프에서 정제된 텍스트를 얻기 위한 NamuwikiExtractor
  ☆18Updated 3 years ago
• LostCow / KLUE
  KLUE Benchmark 1st place (2021.12) solutions. (RE, MRC, NLI, STS, TC)
  ☆25Updated 2 years ago
• nayohan / SimKoR
  [HCLT 2022] Korean sentence text similarity dataset using naver shopping review
  ☆25Updated 2 years ago
• BM-K / KoMiniLM
  Korean Light Weight Language Model
  ☆30Updated last year