ikreymer / cc-index-serverLinks
Deployment of pywb as a CommonCrawl Index Server
☆21Updated 7 years ago
Alternatives and similar repositories for cc-index-server
Users that are interested in cc-index-server are comparing it to the libraries listed below
Sorting:
- DKPro C4CorpusTools is a collection of tools for processing CommonCrawl corpus, including Creative Commons license detection, boilerplate…☆52Updated 5 years ago
- Linking Entities in CommonCrawl Dataset onto Wikipedia Concepts☆59Updated 12 years ago
- Neural Solr = Solr 9 + Mighty Inference + Node☆17Updated 3 years ago
- Tools for bulk indexing of WARC/ARC files on Hadoop, EMR or local file system.☆46Updated 7 years ago
- Homebase of the IPTC EXTRA project about rule-based text categorization☆13Updated 8 years ago
- A toolkit for CDX indices such as Common Crawl and the Internet Archive's Wayback Machine☆179Updated 7 months ago
- ☆44Updated 9 years ago
- spaCy-to-naf converter☆21Updated last month
- Dice.com repo to accompany the dice.com 'Vectors in Search' talk by Simon Hughes, from the Activate 2018 search conference, and the 'Sear…☆86Updated 4 years ago
- Wikidata embedding☆50Updated 9 months ago
- Ranking Entity Types using the Web of Data☆30Updated 8 years ago
- Hadoop jobs for WikiReverse project. Parses Common Crawl data for links to Wikipedia articles.☆38Updated 6 years ago
- ☆19Updated 7 years ago
- CubeQA—Question Answering on Statistical Linked Data☆20Updated last year
- A python library to generate highly realistic typos (fuzz-testing)☆12Updated 4 months ago
- A repository for the "Combining DBpedia and Topic Modeling" GSoC 2016 idea☆13Updated 8 years ago
- Scripts and microservice to feed an ElasticSearch with Wikidata and Inventaire entities, and keep those up-to-date☆41Updated 4 years ago
- Build tables of information by extracting facts from indexed text corpora via a simple and effective query language.☆56Updated 6 years ago
- A workflow system for Natural Language Processing.☆22Updated 5 years ago
- Tools for building a Lucene index for Semantic Vectors☆21Updated 10 years ago
- Supervised learning for novelty detection in text☆78Updated 8 years ago
- A collection of various discourse segmenters☆9Updated 8 years ago
- Extraction Toolkit☆83Updated 3 years ago
- Entity Linking for the masses☆56Updated 9 years ago
- A bunch of fancy soft string matching routines, with some accompanying datasets☆56Updated 7 years ago
- A command-line tool for using CommonCrawl Index API at http://index.commoncrawl.org/☆195Updated 6 years ago
- Entity Extraction Text Processor☆147Updated last year
- Algorithms for "schema matching"☆26Updated 9 years ago
- Solr Dictionary Annotator (Microservice for Spark)☆71Updated 5 years ago
- framework for doing NER and other types of entity recognition, in Python☆68Updated 3 years ago