A library you can include in your Spark job to validate the counters and perform operations on success. Goal is scala/java/python support.
☆108Feb 1, 2018Updated 8 years ago
Alternatives and similar repositories for spark-validator
Users that are interested in spark-validator are comparing it to the libraries listed below
Sorting:
- Base classes to use when writing tests with Spark☆1,549Dec 22, 2025Updated 2 months ago
- Examples for High Performance Spark☆527Updated this week
- Structured Streaming Machine Learning example with Spark 2.0☆94Apr 24, 2017Updated 8 years ago
- ScalaCheck for Spark☆63Apr 2, 2018Updated 7 years ago
- A package full of linear algebra operators for Apache Spark MLlib's linalg package☆10Sep 9, 2015Updated 10 years ago
- An application to monitor and drive the Spark JobServer☆12Dec 12, 2014Updated 11 years ago
- Examples for learning spark☆332Nov 9, 2015Updated 10 years ago
- Dependency and data pipeline management framework for Spark and Scala☆15Apr 8, 2017Updated 8 years ago
- Embedded Kafka for testing and quick prototyping.☆14Apr 19, 2016Updated 9 years ago
- Examples for Fast Data Processing with Spark☆59Sep 10, 2013Updated 12 years ago
- Mirror of Apache MRQL (Incubating)☆17Aug 22, 2017Updated 8 years ago
- Additional useful algorithms that can be used with spark.☆24Dec 24, 2014Updated 11 years ago
- Drizzle integration with Apache Spark☆120Sep 11, 2018Updated 7 years ago
- A spark package for loading Spark ML models to Redis-ML☆63Jun 22, 2019Updated 6 years ago
- Complete Pipeline Training at Big Data Scala By the Bay☆71Oct 27, 2015Updated 10 years ago
- Ansible recipes for Berkeley Data Analytics Stack deployment☆17Aug 7, 2015Updated 10 years ago
- Joins for skewed datasets in Spark☆57Aug 18, 2017Updated 8 years ago
- Low level integration of Spark and Kafka☆130Mar 15, 2018Updated 7 years ago
- Test suite to document the behavior of Spark☆21Apr 15, 2021Updated 4 years ago
- REST job server for Apache Spark☆2,843Jul 8, 2025Updated 7 months ago
- Fluent Scala DSL for Google's Cloud Dataflow SDK☆56Aug 2, 2015Updated 10 years ago
- Secondary sort and streaming reduce for Apache Spark☆78Jul 3, 2023Updated 2 years ago
- Spark, Spark Streaming and Spark SQL unit testing strategies☆215Oct 12, 2016Updated 9 years ago
- Hadoop Profiler, or hprofiler, is a tool which is able to analyze on- and off-CPU workloads on distributed computing environments.☆24Jul 7, 2016Updated 9 years ago
- Coursera Machine Learning class examples in Spark☆43Feb 14, 2014Updated 12 years ago
- Helpers to write Jupyter / IPython kernels on the JVM☆21Apr 29, 2017Updated 8 years ago
- ☆243Jun 14, 2018Updated 7 years ago
- Hakyll support for Agda literate files☆19Jul 20, 2021Updated 4 years ago
- HiveQL Jupyter Kernel☆10Aug 5, 2022Updated 3 years ago
- Visualise your data from Scala using Plotly☆40Aug 15, 2020Updated 5 years ago
- The code for the in memory data pipeline that was presented at Berlin Buzzwords 2015.☆10Jun 1, 2015Updated 10 years ago
- Sprint Planning / Scrum Poker online tool (Akka/Socko Websockets)☆19Dec 22, 2015Updated 10 years ago
- Clifford algebra for Haskell! :D☆14Jul 1, 2014Updated 11 years ago
- Example of use of Spark Streaming with Kafka☆90Jul 11, 2014Updated 11 years ago
- An efficient updatable key-value store for Apache Spark☆254Mar 11, 2017Updated 8 years ago
- An R-like GLM package for Apache Spark☆10Aug 6, 2015Updated 10 years ago
- Visualize streaming machine learning in Spark☆177Jun 29, 2017Updated 8 years ago
- Prescriptive Applications over Kite and Hadoop☆12Oct 14, 2015Updated 10 years ago
- Data science repo to help others☆12Feb 10, 2016Updated 10 years ago