sporveien / bricker
CLI tool for syncing a Databricks folder structure with a local git repo.
☆17Updated 6 months ago
Alternatives and similar repositories for bricker:
Users that are interested in bricker are comparing it to the libraries listed below
- ☕⛵WIP PySpark dependency management☆22Updated 6 years ago
- control spark-shell from vim☆10Updated 8 years ago
- ☆54Updated 7 years ago
- Apache (Py)Spark type annotations (stub files).☆115Updated 2 years ago
- A low-overhead sampling profiler for PySpark, that outputs Flame Graphs☆16Updated 4 years ago
- Presentation about Pyspark and how Arrow makes it faster☆22Updated 4 years ago
- A Giter8 template for scio☆30Updated 2 weeks ago
- Conversion utility from Zeppelin notes to Jupyter notebooks.☆44Updated 5 years ago
- Airflow plugin to transfer arbitrary files between operators☆78Updated 6 years ago
- Example unit tests for Apache Spark Python scripts using the py.test framework☆84Updated 8 years ago
- Google BigQuery support for Spark, Structured Streaming, SQL, and DataFrames with easy Databricks integration.☆70Updated last year
- A pyspark lib to validate data quality☆18Updated 2 years ago
- Make your libraries magically appear in Databricks.☆47Updated last year
- A simplified, autogenerated API client interface using the databricks-cli package☆61Updated last year
- Quickly get a kubernetes executor airflow environment provisioned on GKE. Azure Kubernetes Service instructions included also as are inst…☆36Updated 4 years ago
- pytest plugin to run the tests with support of pyspark☆84Updated 11 months ago
- ☆11Updated 5 years ago
- Create HTML profiling reports from Apache Spark DataFrames☆195Updated 5 years ago
- Airflow workflow management platform chef cookbook.☆71Updated 5 years ago
- Dockerized setup for testing code on realistic hadoop clusters☆27Updated 4 years ago
- Spark package for checking data quality☆221Updated 4 years ago
- Functional Airflow DAG definitions.☆38Updated 7 years ago
- Deploy dask-distributed on google container engine using kubernetes☆40Updated 5 years ago
- Materials for Apache Arrow workshop at VLDB 2019☆42Updated 4 years ago
- Utilities to work with Scala/Java code with py4j☆40Updated last year
- Marshmallow Schema generator for Pandas DataFrames☆24Updated 4 years ago
- MLeap allows for easily putting Spark ML pipelines into production☆78Updated 8 years ago
- Google Spreadsheets datasource for SparkSQL and DataFrames☆57Updated last year
- An external PySpark module that works like R's read.csv or Panda's read_csv, with automatic type inference and null value handling. Parse…☆89Updated 9 years ago
- A tool and library for easily deploying applications on Apache YARN☆142Updated 11 months ago