DavidNemeskey / cc_corpusLinks
Tools for compiling corpora from Common Crawl
☆14Updated last year
Alternatives and similar repositories for cc_corpus
Users that are interested in cc_corpus are comparing it to the libraries listed below
Sorting:
- Text tokenization and sentence segmentation (segtok v2)☆208Updated 3 years ago
- Sentence transformers models for SpaCy☆109Updated 2 years ago
- A tokenizer and sentence splitter for German and English web and social media texts.☆150Updated last year
- A minimal, pure Python library to interface with CoNLL-U format files.☆153Updated last week
- Linguistic and stylistic complexity measures for (literary) texts☆84Updated last year
- Coreference resolution for English, French, German and Polish, optimised for limited training data and easily extensible for further lang…☆197Updated 2 years ago
- Google USE (Universal Sentence Encoder) for spaCy☆184Updated 2 years ago
- Robust and Fast tokenizations alignment library for Rust and Python https://tamuhey.github.io/tokenizations/☆193Updated 2 years ago
- Language independent truecaser in Python.☆159Updated 4 years ago
- Code accompanying the submission "Structural Text Segmentation of Legal Documents" by Aumiller et al.☆98Updated 2 years ago
- This is a simple Python package for calculating a variety of lexical diversity indices☆82Updated 2 years ago
- Examples for aligning, padding and batching sequence labeling data (NER) for use with pre-trained transformer models☆64Updated 3 years ago
- coFR: COreference resolution tool for FRench (and singletons).☆26Updated 5 years ago
- Pipeline component for spaCy (and other spaCy-wrapped parsers such as spacy-stanza and spacy-udpipe) that adds CoNLL-U properties to a Do…☆81Updated last year
- ☆64Updated 2 years ago
- spaCy + UDPipe☆163Updated 3 years ago
- 🧪 Cutting-edge experimental spaCy components and features☆104Updated last year
- DBMDZ BERT, DistilBERT, ELECTRA, GPT-2 and ConvBERT models☆156Updated 3 years ago
- Fuzzy matching and more functionality for spaCy.☆259Updated last year
- BERT and ELECTRA models trained on Europeana Newspapers☆38Updated 4 years ago
- Implementation of the ClausIE information extraction system for python+spacy☆226Updated 3 years ago
- Easier Automatic Sentence Simplification Evaluation☆165Updated 2 years ago
- Coreference resolution for English, French, German and Polish, optimised for limited training data and easily extensible for further lang…☆130Updated last year
- AfroLID, a powerful neural toolkit for African languages identification which covers 517 African languages.☆34Updated 9 months ago
- A module to compute textual lexical richness (aka lexical diversity).☆110Updated 2 years ago
- A python module for English lemmatization and inflection.☆274Updated 2 years ago
- xfspell — the Transformer Spell Checker☆189Updated 5 years ago
- The home repository of the NerKor corpus, a Hungarian gold standard named entity annotated corpus containing 1 million tokens.☆16Updated 2 years ago
- Polish morphological tagger.☆43Updated 2 years ago
- A Super-Lightweight Annotation Tool for Experts: Label text in a terminal with just Python☆112Updated 6 months ago