Alternatives and similar repositories for tongrams-rs

Users that are interested in tongrams-rs are comparing it to the libraries listed below

• daac-tools / crawdad
  🦞 Rust library of natural language dictionaries using character-wise double-array tries.
  ☆31Updated 5 months ago
• kampersanda / sif-embedding
  Rust implementation of SIF and uSIF: Simple and fast sentence embedding
  ☆19Updated 5 months ago
• fulmicoton / kuromoji-rs
  Japanese tokenizer for rust
  ☆35Updated 5 years ago
• daac-tools / trie-match
  Fast match expression optimized for string comparison
  ☆38Updated last year
• daac-tools / python-daachorse
  🐎 A fast implementation of the Aho-Corasick algorithm using the compact double-array data structure. (Python wrapper for daachorse)
  ☆17Updated 3 months ago
• kampersanda / sucds
  Collection of succinct data structures in Rust
  ☆98Updated 3 months ago
• takuyaa / yada
  Yada is a yet another double-array trie library aiming for fast search and compact data representation.
  ☆40Updated last year
• WorksApplications / ViSudachi
  A tool for visualizing the internal structures of morphological analyzer Sudachi
  ☆17Updated 3 years ago
• osyoyu / tantivy-tokenizer-tiny-segmenter
  A Japanese tokenizer for Tantivy, based on TinySegmenter.
  ☆14Updated 4 years ago
• lindera / lindera-tantivy
  Lindera tokenizer for Tantivy.
  ☆59Updated last week
• qnighy / omniswap
  a crate to swap values between possibly-overlapping references
  ☆23Updated 2 years ago
• allenai / rustberta-snli
  🦀 A Rust implementation of a RoBERTa classification model for the SNLI dataset
  ☆13Updated 3 years ago
• daac-tools / find-simdoc
  Finding all pairs of similar documents time- and memory-efficiently
  ☆60Updated 3 months ago
• ynaka81 / in_memory_db_comparison
  In-memory DB performance comparison between python, Go, and Rust
  ☆10Updated 5 years ago
• maekawatoshiki / altius
  Small ONNX inference runtime written in Rust
  ☆99Updated 2 weeks ago
• jermp / tongrams_estimation
  A C++ library implementing fast language models estimation using the 1-Sort algorithm.
  ☆17Updated 2 years ago
• de9uch1 / semsis
  A library for semantic similarity search
  ☆25Updated 4 months ago
• daac-tools / daachorse
  🐎 A fast implementation of the Aho-Corasick algorithm using the compact double-array data structure in Rust.
  ☆220Updated last week
• yoichi1484 / subspace
  An implementation of "Subspace Representations for Soft Set Operations and Sentence Similarities" (NAACL 2024)
  ☆10Updated last year
• optim-corp / masked-lm-wasm
  ☆25Updated 3 years ago
• polm / ipadic-py
  IPAdic packaged for easy use from Python.
  ☆25Updated 3 years ago
• k-yomo / ostrich
  WIP: Full text search engine library written in Go with 1.18+ Generics, heavily inspired by Tantivy
  ☆14Updated 2 years ago
• CyberAgent / fast-annotation-tool
  FAST is an annotation tool that focuses on mobile devices. https://aclanthology.org/2021.emnlp-demo.41/
  ☆53Updated 3 years ago
• kenkoooo / optpy
  optpy is a transpiler to generate a Rust file from a Python file
  ☆25Updated 2 years ago
• teaspn / teaspn-sdk
  SDK for TEASPN, a framework and a protocol for integrated writing assistance environments
  ☆61Updated 2 years ago
• kpu / fasterText
  Library for fast text representation and classification.
  ☆30Updated last year
• Systemcluster / kitoken
  Fast and versatile tokenizer for language models, compatible with SentencePiece, Tokenizers, Tiktoken and more. Supports BPE, Unigram and…
  ☆26Updated 3 months ago
• jpreprocess / jpreprocess
  Japanese text preprocessor for Text-to-Speech applications (OpenJTalk rewrite in rust language)
  ☆43Updated last week
• guillaume-be / SentencePiece-Rust-example
  Supporting example for "A Rust SentencePiece implementation"
  ☆18Updated 5 years ago
• KanHatakeyama / synthetic-texts-by-llm
  ☆26Updated 7 months ago