Alternatives and similar repositories for crawdad

Users that are interested in crawdad are comparing it to the libraries listed below

• WorksApplications / ViSudachi
  A tool for visualizing the internal structures of morphological analyzer Sudachi
  ☆18Updated 3 years ago
• kampersanda / tongrams-rs
  Rust library providing fast language model queries in compressed space
  ☆25Updated 3 years ago
• daac-tools / vaporetto
  🛥 Vaporetto: Very accelerated pointwise prediction based tokenizer
  ☆249Updated 2 weeks ago
• takuyaa / yada
  Yada is a yet another double-array trie library aiming for fast search and compact data representation.
  ☆44Updated last year
• daac-tools / daachorse
  🐎 A fast implementation of the Aho-Corasick algorithm using the compact double-array data structure in Rust.
  ☆237Updated 6 months ago
• daac-tools / find-simdoc
  Finding all pairs of similar documents time- and memory-efficiently
  ☆62Updated 9 months ago
• kampersanda / sif-embedding
  Rust implementation of SIF and uSIF: Simple and fast sentence embedding
  ☆19Updated 11 months ago
• azooKey / AJIMEE-Bench
  AJIMEE-Bench (Advanced Japanese IME Evaluation Benchmark)
  ☆12Updated 11 months ago
• agatan / yoin
  A Japanese Morphological Analyzer written in pure Rust
  ☆26Updated 6 years ago
• WorksApplications / uzushio
  ☆23Updated 11 months ago
• ikegami-yukino / sengiri
  Yet another sentence-level tokenizer for the Japanese text
  ☆24Updated last month
• daac-tools / trie-match
  Fast match expression optimized for string comparison
  ☆40Updated last year
• WorksApplications / chikkarpy
  Japanese synonym library
  ☆55Updated 3 years ago
• megagonlabs / ginza-transformers
  Use custom tokenizers in spacy-transformers
  ☆16Updated 3 years ago
• daac-tools / python-daachorse
  🐎 A fast implementation of the Aho-Corasick algorithm using the compact double-array data structure. (Python wrapper for daachorse)
  ☆20Updated 9 months ago
• lindera / lindera-tantivy
  Lindera tokenizer for Tantivy.
  ☆65Updated 2 weeks ago
• fulmicoton / kuromoji-rs
  Japanese tokenizer for rust
  ☆35Updated 6 years ago
• ctylim / rhuffle
  Line shuffler for huge text file which does not fit in memory
  ☆13Updated 3 years ago
• tsurai / mecab-rs
  Safe Rust bindings for mecab a part-of-speech and morphological analyzer library
  ☆65Updated 2 years ago
• cl-tohoku / keigo_transfer_task
  敬語変換タスクにおける評価用データセット
  ☆21Updated 3 years ago
• japanese-law-analysis / data_set
  法律・判例関係のデータセット
  ☆45Updated 11 months ago
• KanHatakeyama / synthetic-texts-by-llm
  ☆27Updated last year
• kajyuuen / daaja
  This repository has implementations of data augmentation for NLP for Japanese.
  ☆64Updated 2 years ago
• WorksApplications / SudachiTra
  Japanese tokenizer for Transformers
  ☆79Updated 2 years ago
• osyoyu / tantivy-tokenizer-tiny-segmenter
  A Japanese tokenizer for Tantivy, based on TinySegmenter.
  ☆14Updated 4 years ago
• oreilly-japan / building-search-app-w-ml
  『機械学習による検索ランキング改善ガイド』のサンプルコードのリポジトリ
  ☆22Updated 2 years ago
• qnighy / omniswap
  a crate to swap values between possibly-overlapping references
  ☆23Updated 3 years ago
• megagonlabs / bunkai
  Sentence boundary disambiguation tool for Japanese texts (日本語文境界判定器)
  ☆199Updated last year
• po3rin / sudachi-elasticsearch-sample
  Sample of Elasticsearch Docker using Sudachi analizer
  ☆10Updated 2 years ago
• chakki-works / Japanese-Company-Lexicon
  ☆100Updated 2 years ago