kampersanda / tongrams-rsLinks
Rust library providing fast language model queries in compressed space
☆25Updated 2 years ago
Alternatives and similar repositories for tongrams-rs
Users that are interested in tongrams-rs are comparing it to the libraries listed below
Sorting:
- 🦞 Rust library of natural language dictionaries using character-wise double-array tries.☆32Updated 8 months ago
- Rust implementation of SIF and uSIF: Simple and fast sentence embedding☆19Updated 7 months ago
- 🐎 A fast implementation of the Aho-Corasick algorithm using the compact double-array data structure. (Python wrapper for daachorse)☆17Updated 6 months ago
- A tool for visualizing the internal structures of morphological analyzer Sudachi☆17Updated 3 years ago
- 🐎 A fast implementation of the Aho-Corasick algorithm using the compact double-array data structure in Rust.☆231Updated 3 months ago
- Fast match expression optimized for string comparison☆38Updated last year
- Yada is a yet another double-array trie library aiming for fast search and compact data representation.☆41Updated last year
- Lindera tokenizer for Tantivy.☆60Updated 2 weeks ago
- 🦀 A Rust implementation of a RoBERTa classification model for the SNLI dataset☆13Updated 4 years ago
- Collection of succinct data structures in Rust☆99Updated last month
- A soft and fast pattern matcher for billion-scale corpora.☆61Updated 6 months ago
- A library for semantic similarity search☆26Updated 7 months ago
- Japanese tokenizer for rust☆35Updated 5 years ago
- 🛥 Vaporetto: Very accelerated pointwise prediction based tokenizer☆243Updated 2 weeks ago
- FAST is an annotation tool that focuses on mobile devices. https://aclanthology.org/2021.emnlp-demo.41/☆53Updated 3 years ago
- ☆25Updated 3 years ago
- Small ONNX inference runtime written in Rust☆99Updated 3 months ago
- ☆27Updated 10 months ago
- AJIMEE-Bench (Advanced Japanese IME Evaluation Benchmark)☆11Updated 8 months ago
- AllenNLP integration for Shiba: Japanese CANINE model☆12Updated 4 years ago
- Sample of Elasticsearch Docker using Sudachi analizer☆10Updated last year
- A Japanese tokenizer for Tantivy, based on TinySegmenter.☆14Updated 4 years ago
- Finding all pairs of similar documents time- and memory-efficiently☆61Updated 6 months ago
- Japanese text preprocessor for Text-to-Speech applications (OpenJTalk rewrite in rust language)☆45Updated last week
- An annotation tool for grounding of formulae☆23Updated last year
- WIP: Full text search engine library written in Go with 1.18+ Generics, heavily inspired by Tantivy☆14Updated 2 years ago
- Yet another sentence-level tokenizer for the Japanese text☆22Updated 2 years ago
- optpy is a transpiler to generate a Rust file from a Python file☆25Updated 2 years ago
- ☆22Updated 7 months ago
- SDK for TEASPN, a framework and a protocol for integrated writing assistance environments☆60Updated 2 years ago