Alternatives and similar repositories for crawdad:

Users that are interested in crawdad are comparing it to the libraries listed below

• WorksApplications / ViSudachi
  A tool for visualizing the internal structures of morphological analyzer Sudachi
  ☆17Updated 2 years ago
• takuyaa / yada
  Yada is a yet another double-array trie library aiming for fast search and compact data representation.
  ☆36Updated last year
• kampersanda / sif-embedding
  Rust implementation of SIF and uSIF: Simple and fast sentence embedding
  ☆19Updated 2 months ago
• ikegami-yukino / sengiri
  Yet another sentence-level tokenizer for the Japanese text
  ☆22Updated 2 years ago
• daac-tools / trie-match
  Fast match expression optimized for string comparison
  ☆38Updated last year
• agatan / yoin
  A Japanese Morphological Analyzer written in pure Rust
  ☆26Updated 5 years ago
• tsurai / mecab-rs
  Safe Rust bindings for mecab a part-of-speech and morphological analyzer library
  ☆63Updated last year
• kampersanda / tongrams-rs
  Rust library providing fast language model queries in compressed space
  ☆24Updated 2 years ago
• daac-tools / find-simdoc
  Finding all pairs of similar documents time- and memory-efficiently
  ☆60Updated last month
• daac-tools / vaporetto
  🛥 Vaporetto: Very accelerated pointwise prediction based tokenizer
  ☆237Updated last week
• ctylim / rhuffle
  Line shuffler for huge text file which does not fit in memory
  ☆12Updated 2 years ago
• daac-tools / daachorse
  🐎 A fast implementation of the Aho-Corasick algorithm using the compact double-array data structure in Rust.
  ☆213Updated 3 months ago
• WorksApplications / uzushio
  ☆20Updated 2 months ago
• WorksApplications / chikkarpy
  Japanese synonym library
  ☆53Updated 3 years ago
• daac-tools / python-daachorse
  🐎 A fast implementation of the Aho-Corasick algorithm using the compact double-array data structure. (Python wrapper for daachorse)
  ☆16Updated last month
• polm / ipadic-py
  IPAdic packaged for easy use from Python.
  ☆25Updated 3 years ago
• fulmicoton / kuromoji-rs
  Japanese tokenizer for rust
  ☆35Updated 5 years ago
• qnighy / omniswap
  a crate to swap values between possibly-overlapping references
  ☆23Updated 2 years ago
• japanese-law-analysis / data_set
  法律・判例関係のデータセット
  ☆34Updated 3 months ago
• osyoyu / tantivy-tokenizer-tiny-segmenter
  A Japanese tokenizer for Tantivy, based on TinySegmenter.
  ☆14Updated 4 years ago
• shunk031 / allennlp-shiba-model
  AllenNLP integration for Shiba: Japanese CANINE model
  ☆12Updated 3 years ago
• Takeuchi-Lab-LM / python_asa
  python版日本語意味役割付与システム（ASA）
  ☆23Updated 2 years ago
• kenkoooo / optpy
  optpy is a transpiler to generate a Rust file from a Python file
  ☆27Updated 2 years ago
• polm / unidic-lite
  A small version of UniDic for easy pip installs.
  ☆43Updated 4 years ago
• laboroai / Laboro-ParaCorpus
  Scripts for creating a Japanese-English parallel corpus and training NMT models
  ☆16Updated 3 years ago
• daac-tools / python-vaporetto
  🛥 Vaporetto is a fast and lightweight pointwise prediction based tokenizer. This is a Python wrapper for Vaporetto.
  ☆20Updated last month
• KanHatakeyama / synthetic-texts-by-llm
  ☆26Updated 5 months ago
• WorksApplications / SudachiTra
  Japanese tokenizer for Transformers
  ☆80Updated last year
• cl-tohoku / keigo_transfer_task
  敬語変換タスクにおける評価用データセット
  ☆21Updated 2 years ago
• ikegami-yukino / flati
  Flatten nested iterable object for Python (Pure-Python implementation)
  ☆28Updated 5 years ago