Alternatives and similar repositories for localemr

Users that are interested in localemr are comparing it to the libraries listed below

• mrpowers-io / levi
  Delta Lake helper methods. No Spark dependency.
  ☆23Updated 10 months ago
• sodadata / soda-spark
  Soda Spark is a PySpark library that helps you with testing your data in Spark Dataframes
  ☆64Updated 3 years ago
• BasPH / pylint-airflow
  Pylint plugin for static code analysis on Airflow code
  ☆95Updated 4 years ago
• dimajix / flowman
  Flowman is an ETL framework powered by Apache Spark. With its declarative approach, Flowman simplifies the development of complex data pi…
  ☆96Updated this week
• godatadriven / whirl
  Fast iterative local development and testing of Apache Airflow workflows
  ☆202Updated 2 months ago
• acryldata / datahub-helm
  Repository of helm charts for deploying DataHub on a Kubernetes cluster
  ☆191Updated this week
• Nike-Inc / spark-expectations
  A Python Library to support running data quality rules while the spark job is running⚡
  ☆189Updated this week
• ms32035 / airflow-dag-dependencies
  Visualize dependencies between Airflow DAGs
  ☆49Updated 4 years ago
• pipeline-tools / gusty
  Making DAG construction easier
  ☆267Updated this week
• Nike-Inc / brickflow
  Pythonic Programming Framework to orchestrate jobs in Databricks Workflow
  ☆218Updated last month
• ananthdurai / schemata
  Schema modelling framework for decentralised domain-driven ownership of data.
  ☆254Updated last year
• malexer / pytest-spark
  pytest plugin to run the tests with support of pyspark
  ☆86Updated 2 months ago
• astronomer / astronomer-providers
  Airflow Providers containing Deferrable Operators & Sensors from Astronomer
  ☆149Updated last week
• astronomer / airflow-provider-great-expectations
  Great Expectations Airflow operator
  ☆168Updated last week
• getindata / dbt-flink-adapter
  Adapter for dbt that executes dbt pipelines on Apache Flink
  ☆95Updated last year
• dbt-labs / dbt-semantic-interfaces
  The shared semantic layer definitions that dbt-core and MetricFlow use.
  ☆80Updated 2 weeks ago
• rafaelpierre / pyjaws
  PyJaws: A Pythonic Way to Define Databricks Jobs and Workflows
  ☆43Updated last month
• dbt-labs / dbt-spark
  dbt-spark contains all of the code enabling dbt to work with Apache Spark and Databricks
  ☆440Updated last week
• G-Research / spark-extension
  A library that provides useful extensions to Apache Spark and PySpark.
  ☆228Updated last week
• aws / aws-emr-best-practices
  A best practices guide for using AWS EMR. The guide will cover best practices on the topics of cost, performance, security, operational e…
  ☆107Updated last month
• dataflint / spark
  Drop-in replacement for Apache Spark UI
  ☆277Updated this week
• feluelle / airflint
  Enforce Best Practices for all your Airflow DAGs. ⭐
  ☆104Updated this week
• getindata / dbt-airflow-factory
  Library to convert DBT manifest metadata to Airflow tasks
  ☆48Updated last year
• mitchelllisle / sparkdantic
  ✨ A Pydantic to PySpark schema library
  ☆98Updated this week
• awslabs / amazon-emr-vscode-toolkit
  A VS Code Extension to make it easier to manage and develop Spark jobs on EMR
  ☆38Updated 5 months ago
• mitodl / ol-data-platform
  Pipeline definitions for managing data flows to power analytics at MIT Open Learning
  ☆43Updated this week
• getindata / kafka-connect-iceberg-sink
  ☆80Updated 3 months ago
• sfu-db / lineagex
  ☆78Updated 5 months ago
• databand-ai / dbnd
  DBND is an agile pipeline framework that helps data engineering teams track and orchestrate their data processes.
  ☆266Updated 3 months ago
• benchsci / tinsel
  PySpark schema generator
  ☆43Updated 2 years ago