orgtre / google-books-ngram-frequencyLinks
Word/n-gram frequency lists for the Google Books Ngram Corpus (v3, all languages) with Python code
☆79Updated last year
Alternatives and similar repositories for google-books-ngram-frequency
Users that are interested in google-books-ngram-frequency are comparing it to the libraries listed below
Sorting:
- Most common sentences and words for all languages in the OpenSubtitles2018 corpus with Python code☆37Updated 5 months ago
- Open Language Profiles — English profile datasets from CEFR-J☆134Updated 5 years ago
- Gather modern English word frequencies from all enwiki articles.☆218Updated last year
- A modern, interlingual wordnet interface for Python☆254Updated last week
- Wiktionary dump file parser and multilingual data extractor☆946Updated last week
- All the words from Google Books, sorted by frequency☆117Updated 2 years ago
- Python package for WikiMedia dump processing (Wiktionary, Wikipedia etc). Wikitext parsing, template expansion, Lua module execution. Fo…☆103Updated last month
- Hanzipy is a Chinese character and NLP module for Chinese language processing for python. It is primarily written to help provide a frame…☆21Updated this week
- The Open English WordNet☆585Updated 2 weeks ago
- A list of awesome Machine Translation frameworks, libraries, software and papers☆192Updated last year
- A Python Wiktionary Parser☆361Updated 4 months ago
- British English pronunciation dictionary☆95Updated 7 years ago
- CogNet: a large-scale, high-quality cognate database for 338 languages, 1.07M words, and 8.1 million cognates☆49Updated 2 years ago
- Pipeline to generate the Standardized Project Gutenberg Corpus☆186Updated last year
- List of English synonyms and antonyms parsed from the public domain book of James C. Fernald, 1896☆43Updated 6 years ago
- A python module for English lemmatization and inflection.☆268Updated last year
- Tokenizer POS-Tagger and Dependency-parser with BERT/RoBERTa/DeBERTa/GPT models for Japanese and other languages☆52Updated 3 months ago
- Offline bilingual dictionaries made using data from Wiktionary☆56Updated 10 years ago
- Sentence aligner☆115Updated 4 years ago
- Han character library for CJKV languages☆159Updated 4 years ago
- A list of vocabulary lists☆21Updated 5 years ago
- Multilingual sentence alignment using sentence embeddings☆120Updated 8 months ago
- Text to sentence splitter using heuristic algorithm by Philipp Koehn and Josh Schroeder.☆248Updated 2 years ago
- Machine-readable lists of lemma-token pairs in 23 languages.☆341Updated 3 years ago
- Simple multilingual lemmatizer for Python, especially useful for speed and efficiency☆166Updated last month
- Improved Sentence Alignment in Linear Time and Space☆175Updated 2 years ago
- Python library for CJK (Chinese, Japanese, and Korean) language dictionary☆92Updated this week
- English Lemma Database - Compiled by Referencing British National Corpus☆31Updated 9 months ago
- Put together a multilingual corpus from a variety of sources. Used for wordfreq and word embeddings.☆52Updated 4 years ago
- Offline database of synonyms/thesaurus☆197Updated last year