polm / posuto

Related projects ⓘ

Alternatives and complementary repositories for posuto

• taishi-i / toiro
  A comparison tool of Japanese tokenizers
  ☆118Updated 4 months ago
• WorksApplications / SudachiDict
  A lexicon for Sudachi
  ☆232Updated 2 weeks ago
• megagonlabs / bunkai
  Sentence boundary disambiguation tool for Japanese texts (日本語文境界判定器)
  ☆186Updated 7 months ago
• GINK03 / 5ch-analysis
  5chの過去ログをスクレイピングして、過去流行った単語(ex, 香具師, orz)などを追跡調査
  ☆69Updated 5 years ago
• neologd / mecab-unidic-neologd
  Neologism dictionary based on the language resources on the Web for mecab-unidic
  ☆82Updated 4 years ago
• rskmoi / namedivider-python
  A tool for dividing the Japanese full name into a family name and a given name.
  ☆244Updated 3 weeks ago
• MosasoM / inappropriate-words-ja
  日本語における不適切表現を収集します。自然言語処理の時のデータクリーニング用等に使えると思います。
  ☆167Updated 2 years ago
• daac-tools / vaporetto
  🛥 Vaporetto: Very accelerated pointwise prediction based tokenizer
  ☆229Updated this week
• ikegami-yukino / jaconv
  Pure-Python Japanese character interconverter for Hiragana, Katakana, Hankaku, and Zenkaku
  ☆314Updated 2 months ago
• himkt / konoha
  🌿 An easy-to-use Japanese Text Processing tool, which makes it possible to switch tokenizers with small changes of code.
  ☆230Updated 5 months ago
• polm / cutlet
  Japanese to romaji converter in Python
  ☆305Updated 2 months ago
• WorksApplications / sudachi.rs
  Sudachi in Rust 🦀 and new generation of SudachiPy
  ☆318Updated this week
• SamuraiT / tinysegmenter
  tokenizer specified for Japanese
  ☆48Updated 3 years ago
• BandaiNamcoResearchInc / DistilBERT-base-jp
  ☆160Updated 4 years ago
• dataofjapan / land
  ☆151Updated 9 years ago
• WorksApplications / SudachiPy
  Python version of Sudachi, a Japanese tokenizer.
  ☆391Updated 2 years ago
• ikegami-yukino / mozcpy
  Mozc for Python: Kana-Kanji converter
  ☆42Updated 10 months ago
• lo48576 / thinking_faces
  🤔🤔🤔
  ☆155Updated 2 years ago
• t-sagara / jageocoder
  Japanese address geocoder that works both offline and online.
  ☆64Updated last month
• hakatashi / unicode-map
  The Unicode Map Project
  ☆143Updated 3 years ago
• daac-tools / vibrato
  🎤 vibrato: Viterbi-based accelerated tokenizer
  ☆333Updated last month
• ikegami-yukino / neologdn
  Japanese text normalizer for mecab-neologd
  ☆273Updated 6 months ago
• polm / fugashi
  A Cython MeCab wrapper for fast, pythonic Japanese tokenization and morphological analysis.
  ☆398Updated last week
• WorksApplications / chiVe
  Japanese word embedding with Sudachi and NWJC 🌿
  ☆155Updated 8 months ago
• nlp100 / nlp100.github.io
  NLP 100 Exercises
  ☆189Updated 8 months ago
• ikegami-yukino / pymlask
  Emotion analyzer for Japanese text
  ☆114Updated 3 months ago
• himkt / awesome-bert-japanese
  📝 A list of pre-trained BERT models for Japanese with word/subword tokenization + vocabulary construction algorithm information
  ☆129Updated last year
• smartnews-smri / japan-topography
  日本の行政区画（市区町村）・選挙区の地形ファイルをTopoJSONとGeoJSONで公開します。
  ☆81Updated 11 months ago
• studio-ousia / mojimoji
  A fast converter between Japanese hankaku and zenkaku characters
  ☆144Updated 9 months ago
• megagonlabs / ginza
  A Japanese NLP Library using spaCy as framework based on Universal Dependencies
  ☆755Updated 7 months ago