SimpleDataLabsInc / prophecy-build-toolLinks
Prophecy-built-tool (PBT) allows you to quickly build projects generated by Prophecy (your standard Spark Scala and PySpark pipelines) to integrate them with your own CI / CD (e.g. Github Actions), build system (e.g. Jenkins), and orchestration (e.g. Databricks Workflows).
☆28Updated this week
Alternatives and similar repositories for prophecy-build-tool
Users that are interested in prophecy-build-tool are comparing it to the libraries listed below
Sorting:
- Apache Spark testing helpers (dependency free & works with Scalatest, uTest, and MUnit)☆454Updated 3 weeks ago
- Spark Gotchas. A subjective compilation of the Apache Spark tips and tricks☆360Updated 8 years ago
- Essential Spark extensions and helper methods ✨😲☆766Updated 4 months ago
- This is the development repository for sparkMeasure, a tool and library designed for efficient analysis and troubleshooting of Apache Spa…☆809Updated last week
- Base classes to use when writing tests with Spark☆1,549Updated last month
- Qubole Sparklens tool for performance tuning Apache Spark☆587Updated last year
- Avro SerDe for Apache Spark structured APIs.☆242Updated 8 months ago
- A tutorial on the most important features and idioms of Scala that you need to use Spark's Scala APIs.☆675Updated 3 years ago
- A simplified, lightweight ETL Framework based on Apache Spark☆589Updated 2 years ago
- A free tutorial for Apache Spark.☆993Updated last month
- ☆314Updated 7 years ago
- Scala examples for learning to use Spark☆445Updated 5 years ago
- ☆248Updated 6 years ago
- The Internals of Apache Spark☆1,538Updated 7 months ago
- File compaction tool that runs on top of the Spark framework.☆59Updated 6 years ago
- Expressive types for Spark.☆895Updated last week
- The iterative broadcast join example code.☆70Updated 8 years ago
- Spark connector for SFTP☆98Updated 2 years ago
- A Spark UI and Spark History Server alternative with CPU and Memory metrics! Delight is free, cross-platform, and open-source.☆347Updated last year
- Spark Structured Streaming / Kafka / Cassandra / Elastic☆185Updated 3 years ago
- A command-line tool for launching Apache Spark clusters.☆651Updated last year
- Examples for High Performance Spark☆526Updated 3 weeks ago
- A Scala kernel for Jupyter☆1,618Updated last week
- The Internals of Spark Structured Streaming☆422Updated 2 weeks ago
- Serverless proxy for Spark cluster☆324Updated 5 years ago
- Collection of open-source Spark tools & frameworks that have made the data engineering and data science teams at Swoop highly productive☆186Updated 3 months ago
- Kerberos and Hadoop: The Madness beyond the Gate☆282Updated 2 years ago
- Spark style guide☆271Updated last year
- A Spark plugin for reading and writing Excel files☆520Updated last week
- Code snippets for solving common big data problems in various platforms. Inspired by Rosetta Code☆296Updated last year