Alternatives and similar repositories for common_crawl_corpus

Users that are interested in common_crawl_corpus are comparing it to the libraries listed below

• BramVanroy / spacy-extreme
  An example of how to use spaCy for extremely large files without running into memory issues
  ☆36Updated 2 years ago
• transducens / linguacrawl
  Crawling engine that crawls a set of top-level domains looking for documents in a list of languages
  ☆11Updated last year
• liao961120 / concordancer
  Searching in-memory corpus with Corpus Query Language (CQL)
  ☆19Updated 6 months ago
• revuel / PatternOmatic
  Finds linguistic patterns effortlessly
  ☆36Updated last year
• anlausch / ArguminSci
  Analyze Argumentation and Rhetorical Aspects in Scientific Writing.
  ☆19Updated 2 years ago
• dkpro / dkpro-c4corpus
  DKPro C4CorpusTools is a collection of tools for processing CommonCrawl corpus, including Creative Commons license detection, boilerplate…
  ☆52Updated 5 years ago
• wjbmattingly / bagpipes-spacy
  Bagpipes spaCy is a collection of custom spaCy pipeline components designed to enhance text processing capabilities.
  ☆18Updated 10 months ago
• GorkaUrbizu / Coreference-Corpora-Resources
  List of corpora annotated for coreference for different languages
  ☆17Updated 10 months ago
• KBNLresearch / dac
  Entity linker for the newspaper collection of the National Library of the Netherlands. Links named entity mentions to DBpedia description…
  ☆11Updated 2 years ago
• Noahs-ARK / idea_relations
  A framework to identify relations between ideas in temporal text corpora.
  ☆28Updated 7 years ago
• pfeiferd / TopicGrouperJ
  An alternative approach for probabilistic topic modeling based on agglomerative clustering of topics (not documents)
  ☆12Updated 4 years ago
• akb89 / pyfn
  A python module to process data for Frame Semantic Parsing
  ☆24Updated 4 years ago
• kristopherkyle / TAALED
  Tool for the Automatic Assessment of Lexical Diversity
  ☆11Updated 4 years ago
• plkumjorn / GrASP
  An implementation of GrASP (Shnarch et. al., 2017)
  ☆21Updated 2 years ago
• talmago / spacy_crfsuite
  sequence tagging with spaCy and crfsuite
  ☆20Updated 2 years ago
• kermitt2 / grobid-ner
  A Named-Entity Recogniser based on Grobid.
  ☆53Updated last month
• nelson-liu / lexical-semantic-recognition
  ☆17Updated 2 years ago
• stefan-it / gc4lm
  GC4LM: A Colossal (Biased) language model for German
  ☆13Updated 4 years ago
• cisnlp / GlotWeb
  🕸 GlotWeb: Web Indexing for Low-Resource Languages -- under construction.
  ☆13Updated 2 months ago
• ziyin-dl / ngram-word2vec
  ☆17Updated 4 years ago
• cltl / KafNafParserPy
  Parser for KAF NAF files written in Python
  ☆16Updated 3 years ago
• TurkuNLP / wikibert
  BERT models for many languages created from Wikipedia texts
  ☆33Updated 5 years ago
• nlp-uoregon / famie
  FAMIE: A Fast Active Learning Framework for Multilingual Information Extraction
  ☆24Updated 3 years ago
• julianbrooke / GutenTag
  ☆30Updated 8 years ago
• iesl / stance
  Learned string similarity for entity names using optimal transport.
  ☆35Updated 4 years ago
• knowitall / chunkedextractor
  Extractors whose input is a chunked sentence. Includes Relnoun, Nesty, and a scala interface for ReVerb.
  ☆28Updated 7 years ago
• allenai / pybart
  Converter from UD-trees to BART representation
  ☆36Updated last year
• fnielsen / wembedder
  Wikidata embedding
  ☆50Updated 7 months ago
• BramVanroy / astred
  An easy-to-use library to linguistically compare one sentence and its words to another, in the same language or a different one. For inst…
  ☆22Updated 3 years ago
• jaredleekatzman / Wordly
  ADS Project
  ☆14Updated 9 years ago