USCDataScience / sparkler
Spark-Crawler: Apache Nutch-like crawler that runs on Apache Spark.
☆413Updated 2 years ago
Alternatives and similar repositories for sparkler:
Users that are interested in sparkler are comparing it to the libraries listed below
- Tools for reading data from Solr as a Spark RDD and indexing objects from Spark into Solr using SolrJ.☆446Updated last year
- A scalable, mature and versatile web crawler based on Apache Storm☆904Updated last week
- A text tagger based on Lucene / Solr, using FST technology☆176Updated last year
- This project combines Apache Spark and Elasticsearch to enable mining & prediction for Elasticsearch.☆210Updated 10 years ago
- Banana for Solr - A Port of Kibana☆670Updated 7 months ago
- HBase as a TinkerPop Graph Database☆256Updated last week
- Elasticsearch entity resolution plugin based on Duke☆210Updated 4 years ago
- Mazerunner extends a Neo4j graph database to run scheduled big data graph compute algorithms at scale with HDFS and Apache Spark.☆382Updated 2 years ago
- An Elasticsearch ingest processor to do named entity extraction using Apache OpenNLP☆270Updated 2 years ago
- Locality Sensitive Hashing for Apache Spark☆195Updated 8 years ago
- Scalable query engine for web scrapping/data mashup/acceptance QA, powered by Apache Spark☆142Updated this week
- Data Integration Graph☆206Updated 6 years ago
- Morpheus brings the leading graph query language, Cypher, onto the leading distributed processing platform, Spark.☆338Updated 4 years ago
- Code to index HDFS to Solr using MapReduce☆52Updated 6 years ago
- Neo4j Connector for Apache Spark, which provides bi-directional read/write access to Neo4j from Spark, using the Spark DataSource APIs☆313Updated last week
- Spark RDD with Lucene's query and entity linkage capabilities☆125Updated last week
- Elasticsearch Index Termlist☆117Updated 5 years ago
- The Common Crawl Crawler Engine and Related MapReduce code (2008-2012)☆213Updated 2 years ago
- Kite SDK☆392Updated 2 years ago
- Real Time Analytics and Data Pipelines based on Spark Streaming☆525Updated 5 years ago
- Structured Streaming Machine Learning example with Spark 2.0☆92Updated 7 years ago
- ReAir is a collection of easy-to-use tools for replicating tables and partitions between Hive data warehouses.☆283Updated 6 years ago
- A tool for monitoring and tuning Spark jobs for efficiency.☆357Updated 2 years ago
- The Apache Gora open source framework provides an in-memory data model and persistence for big data.☆121Updated last year
- Mirror of Apache Apex core☆349Updated 3 years ago
- Score documents with pure dot product / cosine similarity with ES☆250Updated 3 years ago
- spark + drools☆102Updated 2 years ago
- Highly configurable recommender based on PredictionIO and Mahout's Correlated Cross-Occurrence algorithm☆671Updated 5 years ago
- High-security graph database☆62Updated 2 years ago
- Divolte Collector☆281Updated 3 years ago