lovit/WordPieceModel external links

---

GitHub - View repository

GitHub.dev - Open in online code editor

Star history - Growth chart over time

deps.dev - Dependencies and security vulnerabilities

Gitingest - Export source code for LLM usage

Repomix - Export source code for LLM usage

uithub - Export source code for LLM usage

Close

lovit/WordPieceModel

Readme badge preview -

If you own this repo, copy the snippet below and add it to your README.md

---

Copy

[![RelatedRepos](https://img.shields.io/badge/related-repos-yellow)](https://relatedrepos.com/gh/lovit/WordPieceModel)

Close

lovit / WordPieceModelView on GitHubMore

• External links
• Readme badge

Word Piece Model python light version with functions tokenize/save/load

☆64Oct 1, 2020Updated 5 years ago

Alternatives and similar repositories for WordPieceModel

Users that are interested in WordPieceModel are comparing it to the libraries listed below

• SungjoonPark / KoreanWordVectors

  View on GitHub
  Subword-level Word Vector Representations for Korean (ACL 2018)
  ☆107Oct 17, 2019Updated 6 years ago
• songys / Question_pair

  View on GitHub
  #Paired Question
  ☆24Jun 16, 2020Updated 5 years ago
• simonjisu / nsmc_study

  View on GitHub
  Naver sentiment movie corpus classification
  ☆17Oct 12, 2021Updated 4 years ago
• MrBananaHuman / KorGPT2Tutorial

  View on GitHub
  Tutorial for pretraining Korean GPT-2 model
  ☆67Jun 12, 2023Updated 2 years ago
• warnikchow / dlk2nlp

  View on GitHub
  Day-by-day line-by-line Keras-based Korean NLP
  ☆92Nov 21, 2022Updated 3 years ago
• MrBananaHuman / KalBert

  View on GitHub
  Korean ALBERT
  ☆46Nov 11, 2019Updated 6 years ago
• monologg / KoELECTRA

  View on GitHub
  Pretrained ELECTRA Model for Korean
  ☆630Feb 19, 2024Updated 2 years ago
• kakaobrain / kortok

  View on GitHub
  The code and models for "An Empirical Study of Tokenization Strategies for Various Korean NLP Tasks" (AACL-IJCNLP 2020)
  ☆119Oct 8, 2020Updated 5 years ago
• warnikchow / 3i4k

  View on GitHub
  Intonation-aided intention identification for Korean
  ☆83Nov 21, 2022Updated 3 years ago
• ModuNLP / hacking_transformers

  View on GitHub
  ☆11Aug 12, 2020Updated 5 years ago
• rasoio / daon

  View on GitHub
  한글 형태소 분석기
  ☆21Sep 17, 2018Updated 7 years ago
• lovit / soynlp

  View on GitHub
  한국어 자연어처리를 위한 파이썬 라이브러리입니다. 단어 추출/ 토크나이저 / 품사판별/ 전처리의 기능을 제공합니다.
  ☆984Mar 10, 2026Updated last week
• seopbo / nlp_classification

  View on GitHub
  Implementing nlp papers relevant to classification with PyTorch, gluonnlp
  ☆230Dec 8, 2022Updated 3 years ago
• rsennrich / subword-nmt

  View on GitHub
  Unsupervised Word Segmentation for Neural Machine Translation and Text Generation
  ☆2,267Aug 7, 2024Updated last year
• kakaobrain / kor-nlu-datasets

  View on GitHub
  KorNLI and KorSTS: New Benchmark Datasets for Korean Natural Language Understanding
  ☆310Jul 9, 2023Updated 2 years ago
• lovit / naver_news_search_scraper

  View on GitHub
  검색어 기준으로 네이버뉴스와 댓글을 수집하는 파이썬 코드
  ☆47Jul 23, 2021Updated 4 years ago
• eagle705 / pytorch-bert-crf-ner

  View on GitHub
  KoBERT와 CRF로 만든 한국어 개체명인식기 (BERT+CRF based Named Entity Recognition model for Korean)
  ☆504Feb 11, 2024Updated 2 years ago
• jeongukjae / korean-spacing-model

  View on GitHub
  한국어 문장 띄어쓰기(삭제/추가) 모델입니다. 데이터 준비 후 직접 학습이 가능하도록 작성하였습니다.
  ☆57Jul 11, 2022Updated 3 years ago
• lovit / soyspacing

  View on GitHub
  띄어쓰기 오류 교정 라이브러리입니다. CRF 와 같은 머신러닝 알고리즘이 아닌, 직관적인 접근법으로 띄어쓰기를 교정합니다.
  ☆150Sep 26, 2019Updated 6 years ago
• simsimi / DeepBadSentence

  View on GitHub
  Deep Learning Bad Sentence Classifier
  ☆46Sep 1, 2019Updated 6 years ago
• renll / StateNet

  View on GitHub
  [EMNLP 2018] Towards Universal Dialogue State Tracking
  ☆41Dec 31, 2019Updated 6 years ago
• lovit / soykeyword

  View on GitHub
  Python library for keyword extraction
  ☆39Jul 8, 2021Updated 4 years ago
• Shikib / structured_fusion_networks

  View on GitHub
  Code for SIGDial 2019 Best Paper: Structured Fusion Networks for Dialog https://arxiv.org/abs/1907.10016
  ☆30Aug 19, 2019Updated 6 years ago
• LGAI-Research / SetR

  View on GitHub
  ☆20Sep 11, 2025Updated 6 months ago
• Huffon / nlp-startups

  View on GitHub
  국내 자연어 처리 기술을 연구 및 개발하는 스타트업 목록
  ☆165May 10, 2020Updated 5 years ago
• SimengSun / revisit-nplm

  View on GitHub
  ☆12Sep 1, 2021Updated 4 years ago
• enlipleai / kor_pretrain_LM

  View on GitHub
  https://ailabs.enliple.com/
  ☆105Feb 25, 2021Updated 5 years ago
• shijie-wu / neural-transducer

  View on GitHub
  This repo contains a set of neural transducer, e.g. sequence-to-sequence model, focusing on character-level tasks.
  ☆76Sep 13, 2023Updated 2 years ago
• haven-jeon / ko_en_neural_machine_translation

  View on GitHub
  Korean English NMT(Neural Machine Translation) with Gluon
  ☆61Feb 28, 2018Updated 8 years ago
• lovit / huggingface_konlpy

  View on GitHub
  Training Transformers of Huggingface with KoNLPy
  ☆68Aug 28, 2020Updated 5 years ago
• bluuewhale / NLP_sentiment_classification

  View on GitHub
  NLP Classification Tutorial with PyTorch
  ☆25Feb 22, 2020Updated 6 years ago
• kh-kim / deeplearning_with_pytorch

  View on GitHub
  ☆12Mar 8, 2020Updated 6 years ago
• coolengineer / sejong-corpus

  View on GitHub
  Korean sejong corpus download and simple analysis
  ☆147May 9, 2019Updated 6 years ago
• seujung / gluonnlp_tutorial

  View on GitHub
  GluonNLP tutorial for Pycon2019
  ☆14Aug 16, 2019Updated 6 years ago
• yseokchoi / SejongTree2Dependency

  View on GitHub
  세종 구문 분석 말뭉치의 의존 구문 구조로의 변환 도구
  ☆10Sep 7, 2018Updated 7 years ago
• likejazz / korean-sentence-splitter

  View on GitHub
  Split Korean text into sentences using heuristic algorithm.
  ☆215Dec 24, 2020Updated 5 years ago
• KB-AI-Research / KB-ALBERT

  View on GitHub
  KB국민은행에서 제공하는 경제/금융 도메인에 특화된 한국어 ALBERT 모델
  ☆240Oct 7, 2021Updated 4 years ago
• simonjisu / pytorch_tutorials

  View on GitHub
  some tutorials for blog: simonjisu.github.io
  ☆23Mar 25, 2021Updated 4 years ago
• ukairia777 / bert-topic-models

  View on GitHub
  BERT 기반의 문맥을 반영한 한국어 토픽 모델링 (BERT Contextualized Topic Models)
  ☆41Feb 22, 2022Updated 4 years ago