sporveien / bricker
CLI tool for syncing a Databricks folder structure with a local git repo.
☆17Updated 9 months ago
Alternatives and similar repositories for bricker
Users that are interested in bricker are comparing it to the libraries listed below
Sorting:
- ☕⛵WIP PySpark dependency management☆22Updated 6 years ago
- ☆72Updated 4 years ago
- Spark package for checking data quality☆221Updated 5 years ago
- Apache (Py)Spark type annotations (stub files).☆117Updated 2 years ago
- Utilities to work with Scala/Java code with py4j☆40Updated last year
- control spark-shell from vim☆11Updated 8 years ago
- Splittable SAS (.sas7bdat) Input Format for Hadoop and Spark SQL☆91Updated last year
- Deprecated, please use https://github.com/jcrist/skein or https://github.com/dask/dask-yarn instead☆52Updated 6 years ago
- Airflow workflow management platform chef cookbook.☆71Updated 5 years ago
- An example PySpark project with pytest☆16Updated 7 years ago
- Conversion utility from Zeppelin notes to Jupyter notebooks.☆44Updated 5 years ago
- Google BigQuery support for Spark, Structured Streaming, SQL, and DataFrames with easy Databricks integration.☆70Updated 2 years ago
- A library that brings useful functions from various modern database management systems to Apache Spark☆59Updated last year
- ☆54Updated 7 years ago
- A library you can include in your Spark job to validate the counters and perform operations on success. Goal is scala/java/python support…☆109Updated 7 years ago
- Create HTML profiling reports from Apache Spark DataFrames☆196Updated 5 years ago
- Example unit tests for Apache Spark Python scripts using the py.test framework☆84Updated 9 years ago
- A Giter8 template for scio☆31Updated 3 months ago
- Make your libraries magically appear in Databricks.☆47Updated last year
- Implementations of the Portable Format for Analytics (PFA)☆128Updated 2 years ago
- ☆199Updated last year
- Dockerized setup for testing code on realistic hadoop clusters☆27Updated 4 years ago
- Machine Learning Pipeline Stages for Spark (exposed in Scala/Java + Python)☆74Updated last year
- Unit and integration testing with PySpark can be tough to figure out, let's make that easier.☆22Updated 9 years ago
- Data validation library for PySpark 3.0.0☆33Updated 2 years ago
- Presentation about Pyspark and how Arrow makes it faster☆22Updated 4 years ago
- A pyspark lib to validate data quality☆18Updated 2 years ago
- Python Driver for Apache Drill.☆59Updated 2 years ago
- pytest plugin to run the tests with support of pyspark☆86Updated last month
- MLeap allows for easily putting Spark ML pipelines into production☆78Updated 8 years ago