Alternatives and similar repositories for comcrawl:

Users that are interested in comcrawl are comparing it to the libraries listed below

• commoncrawl / cc-pyspark
  Process Common Crawl data with Python and Spark
  ☆422Updated last month
• commoncrawl / cc-index-table
  Index Common Crawl archives in tabular format
  ☆113Updated 2 weeks ago
• cocrawler / cdx_toolkit
  A toolkit for CDX indices such as Common Crawl and the Internet Archive's Wayback Machine
  ☆169Updated 2 months ago
• adbar / htmldate
  Fast and robust date extraction from web pages, with Python or on the command-line
  ☆123Updated 2 months ago
• kevinlu1248 / pyate
  PYthon Automated Term Extraction
  ☆311Updated 2 years ago
• johnbumgarner / newspaper3_usage_overview
  This repository provides usage examples for the Python module Newspaper3k.
  ☆146Updated last year
• MartinoMensio / spacy-sentence-bert
  Sentence transformers models for SpaCy
  ☆107Updated 2 years ago
• ikreymer / cdx-index-client
  A command-line tool for using CommonCrawl Index API at http://index.commoncrawl.org/
  ☆189Updated 6 years ago
• TeamHG-Memex / html-text
  Extract text from HTML
  ☆134Updated 4 years ago
• GateNLP / ultimate-sitemap-parser
  Ultimate Website Sitemap Parser
  ☆197Updated last week
• jmriebold / BoilerPy3
  Python port of Boilerpipe library
  ☆86Updated 7 months ago
• adbar / courlan
  Clean, filter and sample URLs to optimize data collection – Python & command-line – Deduplication, spam, content and language filters
  ☆135Updated 2 months ago
• MartinoMensio / spacy-dbpedia-spotlight
  A spaCy wrapper for DBpedia Spotlight
  ☆109Updated 2 years ago
• mmxgn / spacy-clausie
  Implementation of the ClausIE information extraction system for python+spacy
  ☆221Updated 2 years ago
• argilla-io / spacy-wordnet
  spacy-wordnet creates annotations that easily allow the use of wordnet and wordnet domains by using the nltk wordnet interface
  ☆254Updated 6 months ago
• gandersen101 / spaczz
  Fuzzy matching and more functionality for spaCy.
  ☆256Updated 8 months ago
• richardpaulhudson / coreferee
  Coreference resolution for English, French, German and Polish, optimised for limited training data and easily extensible for further lang…
  ☆121Updated 11 months ago
• weblyzard / inscriptis
  A python based HTML to text conversion library, command line client and Web service.
  ☆297Updated this week
• lunayach / visNER
  In the wild extraction of entities that are found using Flair and displayed using a very elegant front-end.
  ☆71Updated 2 years ago
• msg-systems / coreferee
  Coreference resolution for English, French, German and Polish, optimised for limited training data and easily extensible for further lang…
  ☆193Updated 2 years ago
• MaartenGr / cTFIDF
  Creating class-based TF-IDF matrices
  ☆83Updated 2 years ago
• daltonfury42 / truecase
  A python true casing utility that restores case information for texts
  ☆88Updated 2 years ago
• Lucaterre / spacyfishing
  A spaCy wrapper of Entity-Fishing (component) for named entity disambiguation and linking on Wikidata
  ☆158Updated 2 years ago
• HazyResearch / bootleg
  Self-Supervision for Named Entity Disambiguation at the Tail
  ☆215Updated 2 years ago
• kennethkenneth / AuthorExtractor
  Source code for the Medium article "Extracting the author of news stories with DOM-based segmentation and BERT"
  ☆29Updated 5 years ago
• scrapinghub / article-extraction-benchmark
  Article extraction benchmark: dataset and evaluation scripts
  ☆307Updated 11 months ago
• aboSamoor / pycld2
  ☆168Updated 9 months ago
• mediacloud / nyt-news-labeler
  Tag news stories based on models trained on the NYT corpus.
  ☆42Updated 2 years ago
• kabirkhan / recon
  Recon NER, Debug and correct annotated Named Entity Recognition (NER) data for inconsistencies and get insights on improving the quality …
  ☆106Updated last year
• crabcamp / lexrank
  LexRank algorithm for text summarization
  ☆231Updated 11 months ago