Alternatives and similar repositories for tongrams-rs:

Users that are interested in tongrams-rs are comparing it to the libraries listed below

• daac-tools / crawdad
  🦞 Rust library of natural language dictionaries using character-wise double-array tries.
  ☆30Updated 2 months ago
• kampersanda / sif-embedding
  Rust implementation of SIF and uSIF: Simple and fast sentence embedding
  ☆19Updated 2 months ago
• daac-tools / python-daachorse
  🐎 A fast implementation of the Aho-Corasick algorithm using the compact double-array data structure. (Python wrapper for daachorse)
  ☆16Updated last week
• WorksApplications / ViSudachi
  A tool for visualizing the internal structures of morphological analyzer Sudachi
  ☆17Updated 2 years ago
• takuyaa / yada
  Yada is a yet another double-array trie library aiming for fast search and compact data representation.
  ☆34Updated last year
• kampersanda / sucds
  Collection of succinct data structures in Rust
  ☆95Updated 2 weeks ago
• daac-tools / trie-match
  Fast match expression optimized for string comparison
  ☆38Updated last year
• allenai / rustberta-snli
  🦀 A Rust implementation of a RoBERTa classification model for the SNLI dataset
  ☆13Updated 3 years ago
• nobu-g / cohesion-analysis
  Code for COLING 2020 Paper
  ☆13Updated 2 weeks ago
• fulmicoton / kuromoji-rs
  Japanese tokenizer for rust
  ☆35Updated 5 years ago
• osyoyu / tantivy-tokenizer-tiny-segmenter
  A Japanese tokenizer for Tantivy, based on TinySegmenter.
  ☆14Updated 3 years ago
• KanHatakeyama / synthetic-texts-by-llm
  ☆25Updated 4 months ago
• qnighy / omniswap
  a crate to swap values between possibly-overlapping references
  ☆23Updated 2 years ago
• primitiv / primitiv-rust
  Rust binding of primitiv
  ☆20Updated 6 years ago
• ikegami-yukino / sengiri
  Yet another sentence-level tokenizer for the Japanese text
  ☆22Updated 2 years ago
• optim-corp / masked-lm-wasm
  ☆25Updated 2 years ago
• lindera / lindera-tantivy
  Lindera tokenizer for Tantivy.
  ☆57Updated 3 months ago
• polm / ipadic-py
  IPAdic packaged for easy use from Python.
  ☆25Updated 3 years ago
• jermp / tongrams_estimation
  A C++ library implementing fast language models estimation using the 1-Sort algorithm.
  ☆17Updated last year
• shunk031 / allennlp-shiba-model
  AllenNLP integration for Shiba: Japanese CANINE model
  ☆12Updated 3 years ago
• daac-tools / daachorse
  🐎 A fast implementation of the Aho-Corasick algorithm using the compact double-array data structure in Rust.
  ☆211Updated 2 months ago
• daac-tools / find-simdoc
  Finding all pairs of similar documents time- and memory-efficiently
  ☆60Updated last week
• wtsnjp / MioGatto
  An annotation tool for grounding of formulae
  ☆23Updated 9 months ago
• kitagry / kj
  Edit and create Kubernetes job from cronjob template using your EDITOR
  ☆17Updated 2 months ago
• megagonlabs / vecscan
  ☆50Updated last year
• daac-tools / python-vaporetto
  🛥 Vaporetto is a fast and lightweight pointwise prediction based tokenizer. This is a Python wrapper for Vaporetto.
  ☆20Updated last week
• k-yomo / ostrich
  WIP: Full text search engine library written in Go with 1.18+ Generics, heavily inspired by Tantivy
  ☆15Updated last year
• guillaume-be / SentencePiece-Rust-example
  Supporting example for "A Rust SentencePiece implementation"
  ☆18Updated 4 years ago
• hiroshi-manabe / CRFSegmenter
  A multi-language segmenter using high-order CRF.
  ☆17Updated 5 years ago