newca12 / dictionary-builderLinks
Real world example to demonstrate advanced techniques to unmarshall very large xml document with very low memory footprint.
☆61Updated 6 months ago
Alternatives and similar repositories for dictionary-builder
Users that are interested in dictionary-builder are comparing it to the libraries listed below
Sorting:
- Pure Rust port of CRFsuite: a fast implementation of Conditional Random Fields (CRFs)☆29Updated 2 weeks ago
- Python package for WikiMedia dump processing (Wiktionary, Wikipedia etc). Wikitext parsing, template expansion, Lua module execution. Fo…☆107Updated last week
- Java Wiktionary Library☆58Updated 2 years ago
- ☆49Updated 3 years ago
- German part-of-speech dictionary☆45Updated 2 years ago
- Tools for scraping, annotating, and parsing morphological information from Wiktionary☆15Updated 5 years ago
- Port of arc90labs-readability with rust☆131Updated last year
- Helsinki Finite-State Technology (library and application suite)☆133Updated 3 weeks ago
- Rust crate for entity parsing☆17Updated 2 years ago
- Spelling correction & Fuzzy search based on Symmetric Delete spelling correction algorithm.☆139Updated 4 months ago
- ☆367Updated last month
- Put together a multilingual corpus from a variety of sources. Used for wordfreq and word embeddings.☆53Updated 4 years ago
- Further developed as SyntaxDot: https://github.com/tensordot/syntaxdot☆13Updated 4 years ago
- Offline etymological dictionary based on Wiktionary data☆21Updated 3 years ago
- Simple multilingual lemmatizer for Python, especially useful for speed and efficiency☆176Updated 4 months ago
- A Rust library for reading and writing WARC files☆56Updated 10 months ago
- Neural syntax annotator, supporting sequence labeling, lemmatization, and dependency parsing.☆78Updated last year
- Lexical data at Unicode☆70Updated last year
- Archived Python/Rust hybrid codebase - see divvun/kbdgen for v3☆26Updated 3 years ago
- Wiktionary parser tool for many language editions.☆54Updated 3 years ago
- an approximate string matching or fuzzy-matching system for spelling correction, normalisation or post-OCR correction (mirror of https://…☆37Updated 2 weeks ago
- Full-text IPFS-friendly and WASM-compatible Search in Rust☆278Updated 4 months ago
- Context-sensitive word embeddings with subwords. In Rust.☆88Updated last year
- Rust wrapper for libxml2☆87Updated 3 weeks ago
- fastText Rust binding☆63Updated last year
- Multilingual implementation of RAKE algorithm for Rust☆34Updated 7 months ago
- This is a new backend implementation of the ANNIS linguistic search and visualization system.☆18Updated last week
- Open morphology for Finnish☆95Updated last month
- Fast English word segmentation in Rust☆100Updated last month
- ☆67Updated 2 years ago