kampersanda / tongrams-rs
Rust library providing fast language model queries in compressed space
☆24Updated 2 years ago
Alternatives and similar repositories for tongrams-rs
Users that are interested in tongrams-rs are comparing it to the libraries listed below
Sorting:
- 🦞 Rust library of natural language dictionaries using character-wise double-array tries.☆30Updated 4 months ago
- Rust implementation of SIF and uSIF: Simple and fast sentence embedding☆19Updated 3 months ago
- 🐎 A fast implementation of the Aho-Corasick algorithm using the compact double-array data structure. (Python wrapper for daachorse)☆17Updated 2 months ago
- Collection of succinct data structures in Rust☆96Updated 2 months ago
- A tool for visualizing the internal structures of morphological analyzer Sudachi☆17Updated 2 years ago
- Fast match expression optimized for string comparison☆38Updated last year
- 🦀 A Rust implementation of a RoBERTa classification model for the SNLI dataset☆13Updated 3 years ago
- Japanese tokenizer for rust☆35Updated 5 years ago
- Lindera tokenizer for Tantivy.☆58Updated 2 weeks ago
- Yada is a yet another double-array trie library aiming for fast search and compact data representation.☆39Updated last year
- A Japanese tokenizer for Tantivy, based on TinySegmenter.☆14Updated 4 years ago
- A library for semantic similarity search☆24Updated 3 months ago
- 🐎 A fast implementation of the Aho-Corasick algorithm using the compact double-array data structure in Rust.☆215Updated 4 months ago
- FAST is an annotation tool that focuses on mobile devices. https://aclanthology.org/2021.emnlp-demo.41/☆53Updated 3 years ago
- Code for COLING 2020 Paper☆13Updated last week
- AllenNLP integration for Shiba: Japanese CANINE model☆12Updated 3 years ago
- A Japanese Morphological Analyzer written in pure Rust☆26Updated 5 years ago
- ☆25Updated 2 years ago
- a crate to swap values between possibly-overlapping references☆23Updated 2 years ago
- Yet another sentence-level tokenizer for the Japanese text☆22Updated 2 years ago
- ☆11Updated 3 years ago
- SDK for TEASPN, a framework and a protocol for integrated writing assistance environments☆61Updated 2 years ago
- Benchmark for Japanese document embedding & vector search☆29Updated last year
- Use custom tokenizers in spacy-transformers☆16Updated 2 years ago
- Finding all pairs of similar documents time- and memory-efficiently☆60Updated 2 months ago
- IPAdic packaged for easy use from Python.☆25Updated 3 years ago
- ☆20Updated 3 months ago
- Rust binding of primitiv☆20Updated 6 years ago
- A Japanese dependency parser based on BERT☆22Updated 2 years ago
- Annotated Fuman Kaitori Center Corpus☆18Updated last year