commoncrawl / gzipstream

Related projects ⓘ

Alternatives and complementary repositories for gzipstream

• trec-kba / streamcorpus
  common data interchange format for document processing pipelines that apply natural language processing tools to large streams of text
  ☆34Updated 8 years ago
• istresearch / traptor
  Traptor -- A distributed Twitter feed
  ☆26Updated 2 years ago
• anjishnu / Crackr
  Keyword Extraction system using Brown Clustering - (This version is trained to extract keywords from job listings)
  ☆18Updated 10 years ago
• eXascaleInfolab / TRank
  Ranking Entity Types using the Web of Data
  ☆30Updated 8 years ago
• semanticize / st
  Semanticizest: dump parser and client
  ☆20Updated 8 years ago
• dedupeio / pyhacrf
  Hidden alignment conditional random field for classifying string pairs.
  ☆25Updated 2 months ago
• seomoz / mozsci
  Data science tools from Moz
  ☆22Updated 7 years ago
• pferrel / solr-recommender
  ☆16Updated 8 years ago
• trec-kba / streamcorpus-pipeline
  framework for making streamcorpus data
  ☆11Updated 7 years ago
• bdewilde / pygotham_2016
  code and slides for my PyGotham 2016 talk, "Higher-level Natural Language Processing with textacy"
  ☆15Updated 8 years ago
• uhh-lt / targer
  A web application tagging and retrieval of arguments in text
  ☆30Updated last year
• bkj / wit
  Algorithms for "schema matching"
  ☆25Updated 8 years ago
• proycon / python-ucto
  This is a Python binding to the tokenizer Ucto. Tokenisation is one of the first step in almost any Natural Language Processing task, yet…
  ☆29Updated 2 months ago
• scrapinghub / page_finder
  Find which links on a web page are pagination links
  ☆29Updated 7 years ago
• xtannier / WebAnnotator
  WebAnnotator is a tool for annotating Web pages. WebAnnotator is implemented as a Firefox extension (https://addons.mozilla.org/en-US/fi…
  ☆48Updated 2 years ago
• idio / json-wikipedia
  Json Wikipedia, contains code to convert the Wikipedia xml dump into a json dump. Questions? https://gitter.im/idio-opensource/Lobby
  ☆17Updated 2 years ago
• zelandiya / maui-standalone
  ☆21Updated 6 years ago
• ikreymer / cc-index-server
  Deployment of pywb as a CommonCrawl Index Server
  ☆21Updated 7 years ago
• capless / docb
  Opinionated Python ORM for DynamoDB
  ☆27Updated 5 years ago
• dbpedia-spotlight / wikipedia-stats-extractor
  Raw Wikipedia counts for entity linking
  ☆19Updated 7 years ago
• diffbot / wikistatsextractor
  Extract statistics from Wikipedia Dump files.
  ☆26Updated 3 years ago
• scrapinghub / kafka-scanner
  High Level Kafka Scanner
  ☆19Updated 7 years ago
• knowitall / implie
  Implicit relation extractor using a natural language model.
  ☆25Updated 6 years ago
• socialsensor / storm-focused-crawler
  Collects multimedia content shared through social networks.
  ☆19Updated 9 years ago
• iesl / learned-string-alignments
  Learning String Alignments for Entity Aliases
  ☆38Updated 5 years ago
• fujimotos / TinyFastSS
  An index data structure for approximate string search.
  ☆23Updated 5 years ago
• commonsearch / gumbocy
  Python binding for gumbo-parser using Cython
  ☆14Updated 8 years ago
• dedupeio / affinegap
  A Cython implementation of the affine gap string distance
  ☆58Updated last year
• anthonygarvan / MinHash
  ☆24Updated 6 years ago