newca12 / dictionary-builderLinks
Real world example to demonstrate advanced techniques to unmarshall very large xml document with very low memory footprint.
☆60Updated 5 months ago
Alternatives and similar repositories for dictionary-builder
Users that are interested in dictionary-builder are comparing it to the libraries listed below
Sorting:
- ☆48Updated 2 years ago
- Pure Rust port of CRFsuite: a fast implementation of Conditional Random Fields (CRFs)☆29Updated 4 months ago
- Python package for WikiMedia dump processing (Wiktionary, Wikipedia etc). Wikitext parsing, template expansion, Lua module execution. Fo…☆106Updated this week
- A Rust library for reading and writing WARC files☆56Updated 9 months ago
- Put together a multilingual corpus from a variety of sources. Used for wordfreq and word embeddings.☆53Updated 4 years ago
- PyTorch models for the ocrs OCR engine☆69Updated last year
- Port of arc90labs-readability with rust☆129Updated last year
- Further developed as SyntaxDot: https://github.com/tensordot/syntaxdot☆13Updated 4 years ago
- Neural syntax annotator, supporting sequence labeling, lemmatization, and dependency parsing.☆78Updated last year
- Multilingual implementation of RAKE algorithm for Rust☆34Updated 6 months ago
- an approximate string matching or fuzzy-matching system for spelling correction, normalisation or post-OCR correction (mirror of https://…☆37Updated 6 months ago
- Full-text IPFS-friendly and WASM-compatible Search in Rust☆276Updated 2 months ago
- Context-sensitive word embeddings with subwords. In Rust.☆87Updated last year
- Simple multilingual lemmatizer for Python, especially useful for speed and efficiency☆171Updated 2 months ago
- Java Wiktionary Library☆58Updated 2 years ago
- ☆364Updated 2 weeks ago
- ☆67Updated 2 years ago
- Spelling correction & Fuzzy search based on Symmetric Delete spelling correction algorithm.☆139Updated 2 months ago
- Rust wrapper for libxml2☆85Updated 2 weeks ago
- A persistent datastore backed by RocksDB with fuzzy key lookup using an arbitrary distance function accelerated by the SymSpell algorithm☆14Updated last year
- A partial port of elasticlunr to Rust. Intended to be used for generating compatible search indices.☆56Updated 5 months ago
- finalfusion embeddings in Rust☆102Updated last year
- Rust crate for entity parsing☆17Updated 2 years ago
- German part-of-speech dictionary☆45Updated last year
- A general purpose processing framework for corpora of scientific documents☆64Updated this week
- Tools for scraping, annotating, and parsing morphological information from Wiktionary☆15Updated 5 years ago
- Fast approximate nearest neighbor searching in Rust, based on HNSW index☆330Updated last month
- Helsinki Finite-State Technology (library and application suite)☆133Updated 3 months ago
- Simple NLP in Rust with Python bindings☆152Updated 2 years ago
- Fast English word segmentation in Rust☆100Updated 2 months ago