kampersanda / tongrams-rsLinks
Rust library providing fast language model queries in compressed space
☆25Updated 3 years ago
Alternatives and similar repositories for tongrams-rs
Users that are interested in tongrams-rs are comparing it to the libraries listed below
Sorting:
- 🦞 Rust library of natural language dictionaries using character-wise double-array tries.☆36Updated 11 months ago
- Rust implementation of SIF and uSIF: Simple and fast sentence embedding☆19Updated 11 months ago
- 🐎 A fast implementation of the Aho-Corasick algorithm using the compact double-array data structure in Rust.☆237Updated 6 months ago
- Lindera tokenizer for Tantivy.☆65Updated 2 weeks ago
- Collection of succinct data structures in Rust☆101Updated 5 months ago
- Japanese tokenizer for rust☆35Updated 6 years ago
- A tool for visualizing the internal structures of morphological analyzer Sudachi☆18Updated 3 years ago
- 🐎 A fast implementation of the Aho-Corasick algorithm using the compact double-array data structure. (Python wrapper for daachorse)☆20Updated 9 months ago
- A Japanese tokenizer for Tantivy, based on TinySegmenter.☆14Updated 4 years ago
- Fast match expression optimized for string comparison☆40Updated last year
- Yada is a yet another double-array trie library aiming for fast search and compact data representation.☆44Updated last year
- 🦀 A Rust implementation of a RoBERTa classification model for the SNLI dataset☆13Updated 4 years ago
- Small ONNX inference runtime written in Rust☆100Updated 2 weeks ago
- 🛥 Vaporetto: Very accelerated pointwise prediction based tokenizer☆249Updated 2 weeks ago
- pure rust implemention of word2vec☆86Updated 2 years ago
- Japanese text preprocessor for Text-to-Speech applications (OpenJTalk rewrite in rust language)☆50Updated this week
- Neural syntax annotator, supporting sequence labeling, lemmatization, and dependency parsing.☆79Updated 2 years ago
- A Japanese Morphological Analyzer written in pure Rust☆26Updated 6 years ago
- An efficient implementation of Partitioned Label Trees & its variations for extreme multi-label classification☆90Updated last year
- AJIMEE-Bench (Advanced Japanese IME Evaluation Benchmark)☆12Updated 11 months ago
- Rust implementation of SIMD-oriented Fast Mersenne Twister (SFMT) using stable SIMD☆33Updated 4 years ago
- Modular Rust transformer/LLM library using Candle☆37Updated last year
- Yet another sentence-level tokenizer for the Japanese text☆24Updated last month
- A library for semantic similarity search☆26Updated 11 months ago
- A C++ library implementing fast language models estimation using the 1-Sort algorithm.☆17Updated 2 years ago
- Rust binding to crfsuite☆25Updated 3 years ago
- Rust binding of primitiv☆20Updated 7 years ago
- Recording Composition Tool Hisui☆22Updated last week
- a crate to swap values between possibly-overlapping references☆23Updated 3 years ago
- In-memory DB performance comparison between python, Go, and Rust☆10Updated 5 years ago