Alternatives and similar repositories for tongrams-rs

Users that are interested in tongrams-rs are comparing it to the libraries listed below

• daac-tools / crawdad
  🦞 Rust library of natural language dictionaries using character-wise double-array tries.
  ☆31Updated 6 months ago
• kampersanda / sif-embedding
  Rust implementation of SIF and uSIF: Simple and fast sentence embedding
  ☆19Updated 5 months ago
• daac-tools / daachorse
  🐎 A fast implementation of the Aho-Corasick algorithm using the compact double-array data structure in Rust.
  ☆224Updated last month
• lindera / lindera-tantivy
  Lindera tokenizer for Tantivy.
  ☆60Updated last week
• daac-tools / python-daachorse
  🐎 A fast implementation of the Aho-Corasick algorithm using the compact double-array data structure. (Python wrapper for daachorse)
  ☆17Updated 3 months ago
• fulmicoton / kuromoji-rs
  Japanese tokenizer for rust
  ☆35Updated 5 years ago
• allenai / rustberta-snli
  🦀 A Rust implementation of a RoBERTa classification model for the SNLI dataset
  ☆13Updated 3 years ago
• takuyaa / yada
  Yada is a yet another double-array trie library aiming for fast search and compact data representation.
  ☆40Updated last year
• osyoyu / tantivy-tokenizer-tiny-segmenter
  A Japanese tokenizer for Tantivy, based on TinySegmenter.
  ☆14Updated 4 years ago
• WorksApplications / ViSudachi
  A tool for visualizing the internal structures of morphological analyzer Sudachi
  ☆17Updated 3 years ago
• daac-tools / trie-match
  Fast match expression optimized for string comparison
  ☆38Updated last year
• daac-tools / vaporetto
  🛥 Vaporetto: Very accelerated pointwise prediction based tokenizer
  ☆239Updated last month
• KanHatakeyama / synthetic-texts-by-llm
  ☆26Updated 8 months ago
• kampersanda / sucds
  Collection of succinct data structures in Rust
  ☆98Updated 4 months ago
• de9uch1 / semsis
  A library for semantic similarity search
  ☆25Updated 5 months ago
• softmatcha / softmatcha
  A soft and fast pattern matcher for billion-scale corpora.
  ☆58Updated 4 months ago
• shunk031 / allennlp-shiba-model
  AllenNLP integration for Shiba: Japanese CANINE model
  ☆12Updated 4 years ago
• polm / ipadic-py
  IPAdic packaged for easy use from Python.
  ☆24Updated 3 years ago
• jpreprocess / jpreprocess
  Japanese text preprocessor for Text-to-Speech applications (OpenJTalk rewrite in rust language)
  ☆43Updated this week
• hotchpotch / wikipedia-passages-jawiki-embeddings-utils
  wikipedia 日本語の文を、各種日本語の embeddings や faiss index へと変換するスクリプト等。
  ☆11Updated last year
• daac-tools / find-simdoc
  Finding all pairs of similar documents time- and memory-efficiently
  ☆60Updated 4 months ago
• megagonlabs / vecscan
  ☆50Updated last year
• optim-corp / masked-lm-wasm
  ☆25Updated 3 years ago
• k-yomo / ostrich
  WIP: Full text search engine library written in Go with 1.18+ Generics, heavily inspired by Tantivy
  ☆14Updated 2 years ago
• ikegami-yukino / sengiri
  Yet another sentence-level tokenizer for the Japanese text
  ☆22Updated 2 years ago
• teaspn / teaspn-sdk
  SDK for TEASPN, a framework and a protocol for integrated writing assistance environments
  ☆60Updated 2 years ago
• nouu-me / document_vector_search_benchmark
  Benchmark for Japanese document embedding & vector search
  ☆29Updated last year
• higumachan / lindera-js
  A lidera japanese tokenizer wrapper for javascript and typescript
  ☆16Updated 3 years ago
• mklf / word2vec-rs
  pure rust implemention of word2vec
  ☆83Updated 2 years ago
• kampersanda / fcsd
  Rust library of fast and compact string dictionary using Front-Coding
  ☆12Updated 3 years ago