kampersanda / tongrams-rsLinks
Rust library providing fast language model queries in compressed space
☆24Updated 2 years ago
Alternatives and similar repositories for tongrams-rs
Users that are interested in tongrams-rs are comparing it to the libraries listed below
Sorting:
- 🦞 Rust library of natural language dictionaries using character-wise double-array tries.☆31Updated 6 months ago
- Rust implementation of SIF and uSIF: Simple and fast sentence embedding☆19Updated 6 months ago
- 🐎 A fast implementation of the Aho-Corasick algorithm using the compact double-array data structure in Rust.☆227Updated last month
- 🐎 A fast implementation of the Aho-Corasick algorithm using the compact double-array data structure. (Python wrapper for daachorse)☆17Updated 4 months ago
- A tool for visualizing the internal structures of morphological analyzer Sudachi☆17Updated 3 years ago
- Yada is a yet another double-array trie library aiming for fast search and compact data representation.☆41Updated last year
- Fast match expression optimized for string comparison☆38Updated last year
- 🦀 A Rust implementation of a RoBERTa classification model for the SNLI dataset☆13Updated 3 years ago
- Japanese tokenizer for rust☆35Updated 5 years ago
- A soft and fast pattern matcher for billion-scale corpora.☆59Updated 5 months ago
- 🛥 Vaporetto: Very accelerated pointwise prediction based tokenizer☆239Updated last month
- Sample of Elasticsearch Docker using Sudachi analizer☆10Updated last year
- Finding all pairs of similar documents time- and memory-efficiently☆61Updated 4 months ago
- Lindera tokenizer for Tantivy.☆60Updated this week
- Collection of succinct data structures in Rust☆99Updated this week
- Small ONNX inference runtime written in Rust☆99Updated 2 months ago
- ☆26Updated 9 months ago
- optpy is a transpiler to generate a Rust file from a Python file☆25Updated 2 years ago
- Yet another sentence-level tokenizer for the Japanese text☆22Updated 2 years ago
- A library for semantic similarity search☆25Updated 6 months ago
- An annotation tool for grounding of formulae☆23Updated last year
- ☆21Updated 6 months ago
- ☆18Updated this week
- FAST is an annotation tool that focuses on mobile devices. https://aclanthology.org/2021.emnlp-demo.41/☆53Updated 3 years ago
- ☆25Updated 3 years ago
- Benchmark for Japanese document embedding & vector search☆29Updated last year
- Rust library of fast and compact string dictionary using Front-Coding☆12Updated 3 years ago
- A Japanese tokenizer for Tantivy, based on TinySegmenter.☆14Updated 4 years ago
- Japanese text preprocessor for Text-to-Speech applications (OpenJTalk rewrite in rust language)☆45Updated this week
- AllenNLP integration for Shiba: Japanese CANINE model☆12Updated 4 years ago