Alternatives and similar repositories for crawdad

Users that are interested in crawdad are comparing it to the libraries listed below

• WorksApplications / ViSudachi
  A tool for visualizing the internal structures of morphological analyzer Sudachi
  ☆17Updated 3 years ago
• daac-tools / vaporetto
  🛥 Vaporetto: Very accelerated pointwise prediction based tokenizer
  ☆239Updated last month
• takuyaa / yada
  Yada is a yet another double-array trie library aiming for fast search and compact data representation.
  ☆40Updated last year
• daac-tools / find-simdoc
  Finding all pairs of similar documents time- and memory-efficiently
  ☆60Updated 4 months ago
• tsurai / mecab-rs
  Safe Rust bindings for mecab a part-of-speech and morphological analyzer library
  ☆63Updated last year
• daac-tools / daachorse
  🐎 A fast implementation of the Aho-Corasick algorithm using the compact double-array data structure in Rust.
  ☆224Updated last month
• kampersanda / tongrams-rs
  Rust library providing fast language model queries in compressed space
  ☆24Updated 2 years ago
• ikegami-yukino / sengiri
  Yet another sentence-level tokenizer for the Japanese text
  ☆22Updated 2 years ago
• agatan / yoin
  A Japanese Morphological Analyzer written in pure Rust
  ☆26Updated 5 years ago
• kampersanda / sif-embedding
  Rust implementation of SIF and uSIF: Simple and fast sentence embedding
  ☆19Updated 5 months ago
• qnighy / omniswap
  a crate to swap values between possibly-overlapping references
  ☆23Updated 2 years ago
• WorksApplications / uzushio
  ☆21Updated 5 months ago
• japanese-law-analysis / data_set
  法律・判例関係のデータセット
  ☆38Updated 6 months ago
• daac-tools / trie-match
  Fast match expression optimized for string comparison
  ☆38Updated last year
• WorksApplications / chikkarpy
  Japanese synonym library
  ☆53Updated 3 years ago
• WorksApplications / SudachiTra
  Japanese tokenizer for Transformers
  ☆79Updated last year
• cl-tohoku / keigo_transfer_task
  敬語変換タスクにおける評価用データセット
  ☆20Updated 2 years ago
• sbintuitions / JMTEB
  The evaluation scripts of JMTEB (Japanese Massive Text Embedding Benchmark)
  ☆64Updated 2 months ago
• shunk031 / allennlp-shiba-model
  AllenNLP integration for Shiba: Japanese CANINE model
  ☆12Updated 4 years ago
• osyoyu / tantivy-tokenizer-tiny-segmenter
  A Japanese tokenizer for Tantivy, based on TinySegmenter.
  ☆14Updated 4 years ago
• Takeuchi-Lab-LM / python_asa
  python版日本語意味役割付与システム（ASA）
  ☆23Updated 2 years ago
• togatoga / kanpyo
  Japanese Morphological Analyzer written in Rust
  ☆104Updated last month
• po3rin / sudachi-elasticsearch-sample
  Sample of Elasticsearch Docker using Sudachi analizer
  ☆10Updated last year
• kajyuuen / daaja
  This repository has implementations of data augmentation for NLP for Japanese.
  ☆64Updated 2 years ago
• megagonlabs / ginza-transformers
  Use custom tokenizers in spacy-transformers
  ☆16Updated 2 years ago
• polm / ipadic-py
  IPAdic packaged for easy use from Python.
  ☆24Updated 3 years ago
• daac-tools / python-vaporetto
  🛥 Vaporetto is a fast and lightweight pointwise prediction based tokenizer. This is a Python wrapper for Vaporetto.
  ☆20Updated last month
• ikegami-yukino / mecab-as-kkc
  Converting Mozc dictionary to MeCab dictionary for Kana-Kanji conversion (KKC)
  ☆14Updated 11 months ago
• megagonlabs / jrte-corpus
  Japanese Realistic Textual Entailment Corpus (NLP 2020, LREC 2020)
  ☆76Updated 2 years ago
• lindera / lindera-tantivy
  Lindera tokenizer for Tantivy.
  ☆60Updated last week