ikreymer / cc-index-serverLinks
Deployment of pywb as a CommonCrawl Index Server
☆21Updated 8 years ago
Alternatives and similar repositories for cc-index-server
Users that are interested in cc-index-server are comparing it to the libraries listed below
Sorting:
- Linking Entities in CommonCrawl Dataset onto Wikipedia Concepts☆59Updated 13 years ago
- DKPro C4CorpusTools is a collection of tools for processing CommonCrawl corpus, including Creative Commons license detection, boilerplate…☆52Updated 5 years ago
- Tools for bulk indexing of WARC/ARC files on Hadoop, EMR or local file system.☆46Updated 7 years ago
- Supervised learning for novelty detection in text☆78Updated 9 years ago
- A command-line tool for using CommonCrawl Index API at http://index.commoncrawl.org/☆205Updated 7 years ago
- ☆44Updated 9 years ago
- spaCy-to-naf converter☆21Updated 5 months ago
- Ranking Entity Types using the Web of Data☆30Updated 9 years ago
- Homebase of the IPTC EXTRA project about rule-based text categorization☆13Updated 8 years ago
- A repository for the "Combining DBpedia and Topic Modeling" GSoC 2016 idea☆13Updated 9 years ago
- Hadoop jobs for WikiReverse project. Parses Common Crawl data for links to Wikipedia articles.☆38Updated 7 years ago
- Dice.com repo to accompany the dice.com 'Vectors in Search' talk by Simon Hughes, from the Activate 2018 search conference, and the 'Sear…☆86Updated 4 years ago
- Wikidata embedding☆51Updated last year
- A toolkit for CDX indices such as Common Crawl and the Internet Archive's Wayback Machine☆187Updated 2 weeks ago
- Entity Linking for the masses☆56Updated 10 years ago
- framework for doing NER and other types of entity recognition, in Python☆68Updated 3 years ago
- Demonstration of using Python to process the Common Crawl dataset with the mrjob framework☆168Updated 3 years ago
- Traptor -- A distributed Twitter feed☆26Updated 3 years ago
- ☆19Updated 7 years ago
- A workflow system for Natural Language Processing.☆21Updated 6 years ago
- Scripts and microservice to feed an ElasticSearch with Wikidata and Inventaire entities, and keep those up-to-date☆41Updated 4 years ago
- The Community-enRiched Open WordNet (CROWN)☆18Updated 9 years ago
- A python library to generate highly realistic typos (fuzz-testing)☆13Updated 8 months ago
- An author identification system based on recur☆21Updated 8 years ago
- R code needed to reproduce Relationship between Reddit Comment Score and Comment Length for 1.66 Billion Comments visualization☆18Updated 10 years ago
- A pipeline for detecting novel information about entities from a stream of text, updating a knowledge base about the entities, and genera…☆32Updated 6 years ago
- Build tables of information by extracting facts from indexed text corpora via a simple and effective query language.☆56Updated 6 years ago
- Index Common Crawl archives in tabular format☆123Updated last week
- AMALGrAM, an English supersense tagger written in Python☆33Updated 8 years ago
- A web application tagging and retrieval of arguments in text☆29Updated 2 years ago