ikreymer / cc-index-serverLinks
Deployment of pywb as a CommonCrawl Index Server
☆21Updated 8 years ago
Alternatives and similar repositories for cc-index-server
Users that are interested in cc-index-server are comparing it to the libraries listed below
Sorting:
- Linking Entities in CommonCrawl Dataset onto Wikipedia Concepts☆59Updated 13 years ago
- Tools for bulk indexing of WARC/ARC files on Hadoop, EMR or local file system.☆47Updated 8 years ago
- ☆19Updated 7 years ago
- DKPro C4CorpusTools is a collection of tools for processing CommonCrawl corpus, including Creative Commons license detection, boilerplate…☆52Updated 5 years ago
- A repository for the "Combining DBpedia and Topic Modeling" GSoC 2016 idea☆13Updated 9 years ago
- Dice.com repo to accompany the dice.com 'Vectors in Search' talk by Simon Hughes, from the Activate 2018 search conference, and the 'Sear…☆86Updated 4 years ago
- Supervised learning for novelty detection in text☆78Updated 9 years ago
- Index Common Crawl archives in tabular format☆124Updated 2 weeks ago
- Python binding for gumbo-parser using Cython☆14Updated 9 years ago
- Vespa application making an index of the CORD-19 dataset.☆40Updated 6 months ago
- Algorithms for "schema matching"☆26Updated 9 years ago
- A workflow system for Natural Language Processing.☆21Updated 6 years ago
- Extraction Toolkit☆83Updated 4 years ago
- Nordlys: Toolkit for entity-oriented and semantic search☆30Updated 4 years ago
- ☆44Updated 9 years ago
- Ranking Entity Types using the Web of Data☆30Updated 9 years ago
- A toolkit for CDX indices such as Common Crawl and the Internet Archive's Wayback Machine☆195Updated last week
- Hadoop jobs for WikiReverse project. Parses Common Crawl data for links to Wikipedia articles.☆38Updated 7 years ago
- Demonstration of using Python to process the Common Crawl dataset with the mrjob framework☆168Updated 3 years ago
- A command-line tool for using CommonCrawl Index API at http://index.commoncrawl.org/☆205Updated 7 years ago
- Traptor -- A distributed Twitter feed☆26Updated 3 years ago
- ☆21Updated 7 years ago
- Entity Linking for the masses☆56Updated 10 years ago
- A collection of simple tutorials for using Fonduer☆100Updated 5 years ago
- framework for doing NER and other types of entity recognition, in Python☆68Updated 3 years ago
- A python library to generate highly realistic typos (fuzz-testing)☆13Updated 9 months ago
- ☆13Updated 8 years ago
- CubeQA—Question Answering on Statistical Linked Data☆21Updated 3 months ago
- spaCy-to-naf converter☆21Updated 6 months ago
- Homebase of the IPTC EXTRA project about rule-based text categorization☆13Updated 8 years ago