USCDataScience / sparkler
Spark-Crawler: Apache Nutch-like crawler that runs on Apache Spark.
☆415Updated 2 years ago
Alternatives and similar repositories for sparkler:
Users that are interested in sparkler are comparing it to the libraries listed below
- A scalable, mature and versatile web crawler based on Apache Storm☆906Updated last week
- Tools for reading data from Solr as a Spark RDD and indexing objects from Spark into Solr using SolrJ.☆446Updated last year
- Scalable query engine for web scrapping/data mashup/acceptance QA, powered by Apache Spark☆142Updated this week
- Serverless proxy for Spark cluster☆325Updated 4 years ago
- Project SnappyData - memory optimized analytics database, based on Apache Spark™ and Apache Geode™. Stream, Transact, Analyze, Predict in…☆1,037Updated 2 years ago
- Spark RDD with Lucene's query and entity linkage capabilities☆127Updated last month
- Mirror of Apache Bahir☆336Updated last year
- Lightweight real-time big data streaming engine over Akka☆762Updated 3 years ago
- Sparkline BI Accelerator provides fast ad-hoc query capability over Logical Cubes. This has been folded into our SNAP Platform(http://bit…☆282Updated 6 years ago
- A Scala feature transformation library for data science and machine learning☆467Updated 2 months ago
- Common library for serving TensorFlow, XGBoost and scikit-learn models in production.☆139Updated last year
- High Performance Kafka Connector for Spark Streaming.Supports Multi Topic Fetch, Kafka Security. Reliable offset management in Zookeeper.…☆632Updated 3 years ago
- HBase as a TinkerPop Graph Database☆257Updated last week
- This project combines Apache Spark and Elasticsearch to enable mining & prediction for Elasticsearch.☆211Updated 10 years ago
- Additional opennlp mapping type for elasticsearch in order to perform named entity recognition☆136Updated 8 years ago
- Data Integration Graph☆206Updated 6 years ago
- A text tagger based on Lucene / Solr, using FST technology☆176Updated last year
- Carrot2 plugin for ElasticSearch☆291Updated 2 years ago
- Continuous scalable web crawler built on top of Flink and crawler-commons☆52Updated 6 years ago
- Build configuration-driven ETL pipelines on Apache Spark☆159Updated 2 years ago
- Elastic Search on Spark☆112Updated 10 years ago
- Write your Spark data to Kafka seamlessly☆174Updated 9 months ago
- A scalable machine learning library on Apache Spark☆793Updated 3 years ago
- A java library for stored queries☆375Updated 2 years ago
- A tool for monitoring and tuning Spark jobs for efficiency.☆357Updated 2 years ago
- Mazerunner extends a Neo4j graph database to run scheduled big data graph compute algorithms at scale with HDFS and Apache Spark.☆382Updated 2 years ago
- Distributed, streaming anomaly detection and prediction with HTM in Apache Flink☆135Updated 7 years ago
- Mirror of Apache Samoa (Incubating)☆248Updated 2 years ago
- Score documents with pure dot product / cosine similarity with ES☆251Updated 3 years ago
- BigData Ecosystem Dataset☆577Updated 3 years ago