google / corpuscrawler
Crawler for linguistic corpora
☆204Updated last year
Alternatives and similar repositories for corpuscrawler:
Users that are interested in corpuscrawler are comparing it to the libraries listed below
- Lexical data at Unicode☆68Updated 7 months ago
- A list of resources for conservation, development, and documentation of endangered, minority, and low or under-resourced human languages.☆34Updated last year
- Sentence aligner☆112Updated 3 years ago
- Morfessor is a tool for unsupervised and semi-supervised morphological segmentation☆191Updated 4 years ago
- The Unicode Cookbook for Linguists☆53Updated 4 years ago
- A multilingual parallel corpus created from translations of the Bible.☆179Updated 7 months ago
- A code for transliterating (romanizing) Arabic text using the American Library Association - Library of Congress (ALA-LC) standard☆47Updated 2 years ago
- The Global WordNet Association Collaborative Inter-Lingual Index☆42Updated 5 months ago
- Transliteration data and models☆56Updated 8 years ago
- A character-wise tokenizer for morphologically rich languages☆27Updated last month
- Automatic extraction of edited sentences from text edition histories.☆83Updated 3 years ago
- Various utilities for processing the data.☆208Updated this week
- Bitextor generates translation memories from multilingual websites☆292Updated 5 months ago
- Indian Language Tagger and Chunker (Hindi, Telugu, Tamil, Marathi, Punjabi, Kanada, Malayalam, Urdu, Bengali)☆40Updated 2 years ago
- The Open Multilingual Wordnet☆61Updated 11 months ago
- These are lists for a variety of languages containing words that are distinctive to each language.☆38Updated 3 years ago
- Lightning Fast Language Prediction 🚀☆166Updated 6 years ago
- Datasets and tools for basic natural language processing.☆380Updated 3 years ago
- German Morphological Analyzer☆47Updated 3 years ago
- List of research and engineering of NLP for American Native/Indigenous Languages.☆90Updated 4 years ago
- Helsinki Finite-State Technology (library and application suite)☆129Updated last week
- A sentence segmenter that actually works!☆305Updated 4 years ago
- Python API to access glottolog/glottolog☆29Updated 5 months ago
- CogNet: a large-scale, high-quality cognate database for 338 languages, 1.07M words, and 8.1 million cognates☆48Updated last year
- OpusFilter - Parallel corpus processing toolkit☆104Updated 3 weeks ago
- A python module for word inflections designed for use with spaCy.☆92Updated 5 years ago
- Collaborative data curation for Glottolog☆160Updated last week
- 📂 Additional lookup tables and data resources for spaCy☆106Updated 2 months ago
- Wiktionary parser tool for many language editions.☆54Updated 2 years ago
- Improved Sentence Alignment in Linear Time and Space☆169Updated 2 years ago