Alternatives and similar repositories for comcrawl:

Users that are interested in comcrawl are comparing it to the libraries listed below

• commoncrawl / cc-pyspark
  Process Common Crawl data with Python and Spark
  ☆410Updated 3 weeks ago
• commoncrawl / cc-index-table
  Index Common Crawl archives in tabular format
  ☆109Updated last month
• cocrawler / cdx_toolkit
  A toolkit for CDX indices such as Common Crawl and the Internet Archive's Wayback Machine
  ☆162Updated 2 weeks ago
• argilla-io / spacy-wordnet
  spacy-wordnet creates annotations that easily allow the use of wordnet and wordnet domains by using the nltk wordnet interface
  ☆253Updated 4 months ago
• bsolomon1124 / pycld3
  Python3 bindings for the Compact Language Detector v3 (CLD3)
  ☆149Updated last year
• davidberenstein1957 / concise-concepts
  This repository contains an easy and intuitive approach to few-shot NER using most similar expansion over spaCy embeddings. Now with enti…
  ☆243Updated last year
• scrapinghub / article-extraction-benchmark
  Article extraction benchmark: dataset and evaluation scripts
  ☆296Updated 8 months ago
• jmriebold / BoilerPy3
  Python port of Boilerpipe library
  ☆86Updated 4 months ago
• richardpaulhudson / holmes-extractor
  Information extraction from English and German texts based on predicate logic
  ☆135Updated last year
• gandersen101 / spaczz
  Fuzzy matching and more functionality for spaCy.
  ☆255Updated 6 months ago
• Hellisotherpeople / CX_DB8
  a contextual, biasable, word-or-sentence-or-paragraph extractive summarizer powered by the latest in text embeddings (Bert, Universal Sen…
  ☆226Updated 2 years ago
• MartinoMensio / spacy-sentence-bert
  Sentence transformers models for SpaCy
  ☆107Updated last year
• kevinlu1248 / pyate
  PYthon Automated Term Extraction
  ☆309Updated last year
• diffbot / knowledge-net
  KnowledgeNet: A Benchmark Dataset for Knowledge Base Population
  ☆267Updated 3 years ago
• msg-systems / coreferee
  Coreference resolution for English, French, German and Polish, optimised for limited training data and easily extensible for further lang…
  ☆193Updated 2 years ago
• aboSamoor / pycld2
  ☆167Updated 7 months ago
• fnl / syntok
  Text tokenization and sentence segmentation (segtok v2)
  ☆203Updated 2 years ago
• ieriii / spacy-annotator
  Spacy NER annotator using ipywidgets
  ☆120Updated 9 months ago
• MartinoMensio / spacy-dbpedia-spotlight
  A spaCy wrapper for DBpedia Spotlight
  ☆107Updated last year
• MaartenGr / cTFIDF
  Creating class-based TF-IDF matrices
  ☆82Updated 2 years ago
• erre-quadro / spikex
  SpikeX - SpaCy Pipes for Knowledge Extraction
  ☆397Updated 3 years ago
• crabcamp / lexrank
  LexRank algorithm for text summarization
  ☆229Updated 9 months ago
• webrecorder / warcio
  Streaming WARC/ARC library for fast web archive IO
  ☆393Updated last month
• JulesBelveze / concepcy
  💫 SpaCy wrapper for ConceptNet 💫
  ☆89Updated last year
• TeamHG-Memex / html-text
  Extract text from HTML
  ☆133Updated 4 years ago
• HazyResearch / bootleg
  Self-Supervision for Named Entity Disambiguation at the Tail
  ☆213Updated 2 years ago
• weblyzard / inscriptis
  A python based HTML to text conversion library, command line client and Web service.
  ☆281Updated last week
• adbar / htmldate
  Fast and robust date extraction from web pages, with Python or on the command-line
  ☆121Updated 2 weeks ago
• explosion / spacy-experimental
  🧪 Cutting-edge experimental spaCy components and features
  ☆96Updated 8 months ago
• deepset-ai / rasa-haystack
  ☆46Updated last year