commoncrawl / cc-warc-examples
CommonCrawl WARC/WET/WAT examples and processing code for Java + Hadoop
☆38Updated 5 months ago
Alternatives and similar repositories for cc-warc-examples
Users that are interested in cc-warc-examples are comparing it to the libraries listed below
Sorting:
- CommonCrawl WARC/WET/WAT examples and processing code for Java + Hadoop☆56Updated 4 years ago
- Fusion demo app searching open-source project data from the Apache Software Foundation☆42Updated 6 years ago
- WARC (Web Archive) Input and Output Formats for Hadoop☆35Updated 10 years ago
- Combines Apache OpenNLP and Apache Tika and provides facilities for automatically deriving sentiment from text.☆34Updated 2 years ago
- Java implementation of the TextRank algorithm by Mihalcea, et al.☆75Updated 4 years ago
- Code examples on how to use the Datumbox Machine Learning Framework.☆42Updated last year
- Text Mining Library with a focus on Latent Semantic Analysis☆12Updated 11 years ago
- Parse wikipedia dumps and index (some) page data to elasticsearch☆49Updated 9 years ago
- A library of examples showing how to use the Common Crawl corpus (2008-2012, ARC format)☆65Updated 8 years ago
- A set of reusable Java components that implement functionality common to any web crawler☆244Updated 3 weeks ago
- ☆49Updated 8 years ago
- Simple FieldCache based query introspection Solr Search Component - solves the 'red sofa' problem☆12Updated 3 months ago
- InsightEdge Core☆20Updated last year
- Apache OpenNLP Sandbox☆43Updated this week
- Hadoop jobs for WikiReverse project. Parses Common Crawl data for links to Wikipedia articles.☆38Updated 6 years ago
- Solr Dictionary Annotator (Microservice for Spark)☆71Updated 5 years ago
- Extract statistics from Wikipedia Dump files.☆26Updated 3 years ago
- A text tagger based on Lucene / Solr, using FST technology☆176Updated last year
- A framework for scalable graph computing.☆147Updated 6 years ago
- RDF store on a cloud-based architecture (previously on https://code.google.com/p/cumulusrdf)☆31Updated 9 years ago
- The WikiBrain Java library enables researchers and developers to incorporate state-of-the-art Wikipedia-based algorithms and technologies…☆93Updated 6 years ago
- A Query Autofiltering SearchComponent for Solr that can translate free-text queries into structured queries using index metadata☆28Updated 6 years ago
- Sentiment analysis framework developed by CERTH.☆22Updated 9 years ago
- Named Entity Extraction on Twitter Stream using Apache Spark Streaming and Stanford CoreNLP☆15Updated 8 years ago
- Apache Spark under Docker☆9Updated 9 years ago
- The first Open Source document analysis platform☆65Updated 3 years ago
- English Dependency Relationship Extractor☆85Updated 4 months ago
- Graph Processing Algorithms on top of Neo4j☆39Updated 7 years ago
- The Common Crawl Crawler Engine and Related MapReduce code (2008-2012)☆215Updated 2 years ago
- Machine Learning for Cascading☆81Updated 9 years ago