ikreymer / cc-index-serverLinks
Deployment of pywb as a CommonCrawl Index Server
☆21Updated 7 years ago
Alternatives and similar repositories for cc-index-server
Users that are interested in cc-index-server are comparing it to the libraries listed below
Sorting:
- Linking Entities in CommonCrawl Dataset onto Wikipedia Concepts☆59Updated 12 years ago
- Supervised learning for novelty detection in text☆78Updated 8 years ago
- DKPro C4CorpusTools is a collection of tools for processing CommonCrawl corpus, including Creative Commons license detection, boilerplate…☆52Updated 5 years ago
- ☆19Updated 7 years ago
- Dice.com repo to accompany the dice.com 'Vectors in Search' talk by Simon Hughes, from the Activate 2018 search conference, and the 'Sear…☆86Updated 4 years ago
- ☆44Updated 9 years ago
- ☆21Updated 7 years ago
- A workflow system for Natural Language Processing.☆21Updated 5 years ago
- Hadoop jobs for WikiReverse project. Parses Common Crawl data for links to Wikipedia articles.☆38Updated 7 years ago
- Neural Solr = Solr 9 + Mighty Inference + Node☆17Updated 3 years ago
- An example of how to use spaCy for extremely large files without running into memory issues☆36Updated 2 years ago
- Tools for bulk indexing of WARC/ARC files on Hadoop, EMR or local file system.☆46Updated 7 years ago
- A Python library for learning from dimensionality reduction, supporting sparse and dense matrices.☆78Updated 8 years ago
- Python binding for gumbo-parser using Cython☆14Updated 9 years ago
- A python library to generate highly realistic typos (fuzz-testing)☆12Updated 5 months ago
- spaCy-to-naf converter☆21Updated 2 months ago
- Vespa application making an index of the CORD-19 dataset.☆39Updated last month
- Algorithms for "schema matching"☆26Updated 9 years ago
- Entity Linking for the masses☆56Updated 9 years ago
- framework for doing NER and other types of entity recognition, in Python☆68Updated 3 years ago
- ☆30Updated 3 years ago
- Demonstration of using Python to process the Common Crawl dataset with the mrjob framework☆167Updated 3 years ago
- A repository for the "Combining DBpedia and Topic Modeling" GSoC 2016 idea☆13Updated 8 years ago
- Tools for building a Lucene index for Semantic Vectors☆21Updated 10 years ago
- code and data used to build a training dataset for dragnet models☆10Updated 4 years ago
- Wikidata embedding☆51Updated 9 months ago
- Solr Dictionary Annotator (Microservice for Spark)☆71Updated 5 years ago
- Ranking Entity Types using the Web of Data☆30Updated 8 years ago
- Topic modeling web application☆40Updated 10 years ago
- Implicit relation extractor using a natural language model.☆24Updated 7 years ago