cguegi / azure-databricks-airflow-example
Example of orchestrating dependent Databricks jobs using Airflow
☆11Updated 4 years ago
Related projects ⓘ
Alternatives and complementary repositories for azure-databricks-airflow-example
- An example PySpark project with pytest☆17Updated 7 years ago
- notebooks for nlp-on-spark☆13Updated 7 years ago
- My Study guide used to pass the CRT020 Spark Certification exam☆31Updated 4 years ago
- Partly lecture and partly a hands-on tutorial and workshop, this is a three part series on how to get started with MLflow. In this four p…☆38Updated 3 years ago
- ☆29Updated 3 years ago
- A set of example build and release pipelines for deploying Python and Scala to Azure Databricks and HDInsight☆13Updated 4 years ago
- Mastering Spark for Data Science, published by Packt☆46Updated last year
- Data Engineering with Spark and Delta Lake☆89Updated last year
- ☆16Updated last year
- End-to-end Machine Learning Pipeline demo using Delta Lake, MLflow and AzureML in Azure Databricks☆18Updated 5 years ago
- Workshop for Spark and Databricks☆54Updated 4 years ago
- Data pipeline project using Data Factory, Databricks and Cosmosdb Graph, deployed using Azure DevOps, secured using firewalls and Azure A…☆11Updated last year
- code, labs and lectures for the course☆45Updated last year
- PyConDE & PyData Berlin 2019 Airflow Workshop: Airflow for machine learning pipelines.☆46Updated last year
- Spark and Delta Lake Workshop☆22Updated 2 years ago
- Batch Processing , orchestration using Apache Airflow and Google Workflows, spark structured Streaming and a lot more☆19Updated 2 years ago
- AWS Big Data Certification☆25Updated last year
- Nested Data (JSON/AVRO/XML) Parsing and Flattening in Spark☆15Updated 10 months ago
- Collection of Machine Learning Examples for Azure Databricks☆39Updated 4 years ago
- Data validation library for PySpark 3.0.0☆34Updated 2 years ago
- Quickstart PySpark with Anaconda on AWS/EMR using Terraform☆47Updated 11 months ago
- Repository used for Spark Trainings☆53Updated last year
- ☆19Updated last year
- Code that was used as an example during the Data+AI Summit 2020☆15Updated 3 years ago
- Partly lecture and partly a hands-on tutorial and workshop, this is a three part series on how to get started with MLflow. In this four p…☆32Updated 4 years ago
- Airflow training for the crunch conf☆105Updated 6 years ago
- PySpark phonetic and string matching algorithms☆35Updated 9 months ago