USCDataScience / sparklerLinks
Spark-Crawler: Apache Nutch-like crawler that runs on Apache Spark.
☆417Updated 2 years ago
Alternatives and similar repositories for sparkler
Users that are interested in sparkler are comparing it to the libraries listed below
Sorting:
- A scalable, mature and versatile web crawler based on Apache Storm☆932Updated last week
- Tools for reading data from Solr as a Spark RDD and indexing objects from Spark into Solr using SolrJ.☆445Updated last week
- Spark RDD with Lucene's query and entity linkage capabilities☆128Updated last week
- A text tagger based on Lucene / Solr, using FST technology☆177Updated last year
- An Elasticsearch ingest processor to do named entity extraction using Apache OpenNLP☆274Updated 2 years ago
- A set of reusable Java components that implement functionality common to any web crawler☆247Updated this week
- Scalable query engine for web scrapping/data mashup/acceptance QA, powered by Apache Spark☆142Updated this week
- The Common Crawl Crawler Engine and Related MapReduce code (2008-2012)☆220Updated 2 years ago
- Serverless proxy for Spark cluster☆325Updated 4 years ago
- Query preprocessor for Java-based search engines (Querqy Core and Lucene implementation)☆187Updated last week
- Data Integration Graph☆207Updated 7 years ago
- Carrot2 plugin for ElasticSearch☆291Updated 2 years ago
- This project combines Apache Spark and Elasticsearch to enable mining & prediction for Elasticsearch.☆211Updated 10 years ago
- Norconex Crawlers (or spiders) are flexible web and filesystem crawlers for collecting, parsing, and manipulating data from the web or fi…☆194Updated last week
- Dice Solr Plugins from Simon Hughes Dice.com☆88Updated 4 years ago
- The Apache Gora open source framework provides an in-memory data model and persistence for big data.☆122Updated last year
- HBase as a TinkerPop Graph Database☆261Updated last week
- Mirror of Apache Atlas (Incubating)☆95Updated 2 years ago
- Demo quering counts of a event stream with Apache Flink☆23Updated 7 years ago
- Mirror of Apache Bahir☆335Updated 2 years ago
- Elasticsearch entity resolution plugin based on Duke☆209Updated 5 years ago
- Mazerunner extends a Neo4j graph database to run scheduled big data graph compute algorithms at scale with HDFS and Apache Spark.☆383Updated 2 years ago
- Easily make RESTful web services for time series reporting with Big Data analytics engines like Druid and SQL Databases.☆175Updated 2 years ago
- Apache Spark applications☆70Updated 7 years ago
- Kite SDK☆394Updated 2 years ago
- Behemoth is an open source platform for large scale document analysis based on Apache Hadoop.☆283Updated 7 years ago
- Streaming tweets with spark, language detection & sentiment analysis, dashboard with Kibana☆104Updated 9 years ago
- Additional opennlp mapping type for elasticsearch in order to perform named entity recognition☆136Updated 9 years ago
- Mirror of Apache DataFu☆120Updated 3 months ago
- Sparkline BI Accelerator provides fast ad-hoc query capability over Logical Cubes. This has been folded into our SNAP Platform(http://bit…☆282Updated 7 years ago