Alternatives and similar repositories for Compare-tokenizer:

Users that are interested in Compare-tokenizer are comparing it to the libraries listed below

• monologg / ko_lm_dataformat
  A utility for storing and reading files for Korean LM training 💾
  ☆36Updated last year
• hkjeon13 / noising-korean
  한국어 문서에 노이즈를 추가합니다.
  ☆27Updated 2 years ago
• monologg / KoELECTRA-Pipeline
  Transformers Pipeline with KoELECTRA
  ☆40Updated last year
• seujung / kolang-t5-base
  T5-base model for Korean
  ☆26Updated 3 years ago
• seujung / t5-summarization
  ☆26Updated 4 years ago
• inmoonlight / yajatime
  야자타임 (a.k.a. 야밤의 자연어처리 타임)
  ☆27Updated 4 years ago
• kakaoenterprise / KorAdvMRSTestData
  Adversarial Test Dataset for Korean Multi-turn Response Selection
  ☆34Updated 3 years ago
• snoop2head / KLUE-RBERT
  ↔️ Utilizing RBERT model structure for KLUE Relation Extraction task
  ☆15Updated 2 years ago
• soeque1 / KoGPT2-DINO
  ☆20Updated 3 years ago
• BM-K / KoSentenceBERT_V2
  KoSentenceBERT 모델 구조 변경으로 성능 향상
  ☆10Updated 4 years ago
• hyunwoongko / kobart-transformers
  Kobart model on Huggingface transformers
  ☆63Updated 3 years ago
• LostCow / KLUE
  KLUE Benchmark 1st place (2021.12) solutions. (RE, MRC, NLI, STS, TC)
  ☆25Updated 3 years ago
• lovit / huggingface_konlpy
  Training Transformers of Huggingface with KoNLPy
  ☆68Updated 4 years ago
• jason9693 / oslo-kogpt-finetunig
  kogpt를 oslo로 파인튜닝하는 예제.
  ☆23Updated 2 years ago
• MrBananaHuman / KalBert
  Korean ALBERT
  ☆47Updated 5 years ago
• lih0905 / WSD_kor
  한국어 어휘 의미 분석 모델
  ☆21Updated 3 years ago
• taeminlee / KoGPT2-Transformers
  KoGPT2 on Huggingface Transformers
  ☆33Updated 3 years ago
• monologg / dotfiles
  Simple setup for personal dotfiles
  ☆11Updated last year
• nayohan / SimKoR
  [HCLT 2022] Korean sentence text similarity dataset using naver shopping review
  ☆25Updated 2 years ago
• MrBananaHuman / KoGPT2ForParaphrasing
  TEMP
  ☆34Updated 5 years ago
• BM-K / Styling-Chatbot-with-Transformer
  Language Style과 감정에 따른 챗봇 답변 변화 모델
  ☆33Updated 3 years ago
• monologg / kakaotrans
  [Unofficial] Kakaotrans: Kakao translate API for python
  ☆16Updated 5 years ago
• songys / Question_pair
  #Paired Question
  ☆23Updated 4 years ago
• lovit / levenshtein_finder
  Similar string search in Levenshtein distance
  ☆21Updated 3 years ago
• lyeoni / KorQuAD
  KorQuAD (Korean Question Answering Dataset) submission guide using PyTorch pretrained BERT
  ☆31Updated 5 years ago
• jeongukjae / korean-wikipedia-corpus
  문장단위로 분절된 한국어 위키피디아 코퍼스. Releases에서 다운로드 받거나 tfds-korean으로 사용해주세요.
  ☆24Updated last year
• ModuNLP / weekly-meeting
  매주 목요일, 20:00 모임
  ☆16Updated 4 years ago
• jinmang2 / AdvancedTransformers
  ⛩ All about Korean Transformers (information and tutorial)
  ☆19Updated 2 years ago
• inmoonlight / koco
  Easy installer of kocohub dataset
  ☆24Updated 4 years ago
• monologg / korean-hate-speech-koelectra
  Bias, Hate classification with KoELECTRA 👿
  ☆27Updated last year