commoncrawl / cc-warc-examples
CommonCrawl WARC/WET/WAT examples and processing code for Java + Hadoop
☆37Updated last month
Alternatives and similar repositories for cc-warc-examples:
Users that are interested in cc-warc-examples are comparing it to the libraries listed below
- CommonCrawl WARC/WET/WAT examples and processing code for Java + Hadoop☆56Updated 3 years ago
- Fusion demo app searching open-source project data from the Apache Software Foundation☆42Updated 6 years ago
- A set of reusable Java components that implement functionality common to any web crawler☆240Updated last month
- The Common Crawl Crawler Engine and Related MapReduce code (2008-2012)☆212Updated 2 years ago
- Combines Apache OpenNLP and Apache Tika and provides facilities for automatically deriving sentiment from text.☆33Updated last year
- Text Mining Library with a focus on Latent Semantic Analysis☆12Updated 11 years ago
- Custom graph algorithms for Neo4j with own Java and REST APIs☆34Updated 8 years ago
- Tutorial on parsing Enron email to Avro and then explore the email set using Spark.☆51Updated 6 months ago
- Graph Processing Algorithms on top of Neo4j☆39Updated 7 years ago
- An efficient and flexible token-based regular expression language and engine.☆75Updated 10 years ago
- Angular JS Solr and Elasticsearch and OpenSearch Diagnostic Search Services☆26Updated 7 months ago
- A new object-graph-wrapper for the Tinkerpop 3 graph stack.☆40Updated 3 years ago
- Apache OpenNLP Sandbox☆43Updated this week
- A single docker image that combines Neo4j Mazerunner and Apache Spark GraphX into a powerful all-in-one graph processing engine☆46Updated 5 years ago
- A text tagger based on Lucene / Solr, using FST technology☆176Updated last year
- Parse wikipedia dumps and index (some) page data to elasticsearch☆49Updated 9 years ago
- WARC (Web Archive) Input and Output Formats for Hadoop☆35Updated 10 years ago
- Solr Dictionary Annotator (Microservice for Spark)☆71Updated 4 years ago
- Behemoth is an open source platform for large scale document analysis based on Apache Hadoop.☆281Updated 6 years ago
- RDF store on a cloud-based architecture (previously on https://code.google.com/p/cumulusrdf)☆31Updated 8 years ago
- Creates a hierachical JSON file index that is accessible over HTTP GET requests.☆29Updated 11 years ago
- Educational Examle of a custom Lucene Query & Scorer☆48Updated 4 years ago
- A Query Autofiltering SearchComponent for Solr that can translate free-text queries into structured queries using index metadata☆28Updated 6 years ago
- Mirror of Apache Lucene + Solr☆48Updated 5 years ago
- GraphAware Module for Expiring (Deleting) Nodes and Relationships☆29Updated 3 years ago
- Common web archive utility code.☆52Updated last month
- Scala utilities for teaching computational linguistics and prototyping algorithms.☆42Updated 12 years ago
- Server endpoint for communicating with stanford-ner server☆25Updated 6 years ago
- ☆28Updated 8 years ago
- The Cognitive Foundry is an open-source Java library for building intelligent systems using machine learning☆132Updated 3 years ago