Alternatives and similar repositories for data-environment:

Users that are interested in data-environment are comparing it to the libraries listed below

• sdaberdaku / spark-with-glue-builder
  Docker image that builds a patched Apache Spark with AWS Glue support as metastore
  ☆15Updated 9 months ago
• bitsondatadev / trino-getting-started
  ☆261Updated 5 months ago
• allisonwang-db / pyspark-data-sources
  Custom PySpark Data Sources
  ☆42Updated this week
• delta-io / delta-examples
  Delta Lake examples
  ☆221Updated 5 months ago
• Nike-Inc / spark-expectations
  A Python Library to support running data quality rules while the spark job is running⚡
  ☆180Updated 2 weeks ago
• pracdata / awesome-open-source-data-engineering
  A curated list of open source tools used in analytics platforms and data engineering ecosystem
  ☆286Updated 3 weeks ago
• MrPowers / mack
  Delta Lake helper methods in PySpark
  ☆322Updated 6 months ago
• dbt-labs / dbt-spark
  dbt-spark contains all of the code enabling dbt to work with Apache Spark and Databricks
  ☆424Updated last month
• Armaan1Gohil / dataengineering-tech-stack
  Local Environment to Practice Data Engineering
  ☆143Updated 3 months ago
• dominikhei / Local-Data-LakeHouse
  Sample Data Lakehouse deployed in Docker containers using Apache Iceberg, Minio, Trino and a Hive Metastore. Can be used for local testin…
  ☆63Updated last year
• Nike-Inc / brickflow
  Pythonic Programming Framework to orchestrate jobs in Databricks Workflow
  ☆212Updated last week
• delta-io / kafka-delta-ingest
  A highly efficient daemon for streaming data from Kafka into Delta Lake
  ☆393Updated 3 weeks ago
• alexott / databricks-playground
  Code samples, etc. for Databricks
  ☆63Updated 2 weeks ago
• arezamoosavi / AcidOnSpark-ETL
  Delta-Lake, ETL, Spark, Airflow
  ☆46Updated 2 years ago
• apache / iceberg-python
  Apache PyIceberg
  ☆657Updated this week
• bitol-io / open-data-contract-standard
  Home of the Open Data Contract Standard (ODCS).
  ☆468Updated this week
• conveyordata / data-product-portal
  Data product portal created by Dataminded
  ☆180Updated this week
• l-mds / local-data-stack
  Slow & local data allows you to move fast and deliver business value for the 99.9% of the data challenges.
  ☆186Updated 2 weeks ago
• delta-incubator / delta-lake-definitive-guide
  ☆34Updated 2 months ago
• abeltavares / real-time-data-pipeline
  📡 Real-time data pipeline with Kafka, Flink, Iceberg, Trino, MinIO, and Superset. Ideal for learning data systems.
  ☆41Updated 2 months ago
• dataflint / spark
  Performance Observability for Apache Spark
  ☆239Updated last week
• adidas / lakehouse-engine
  The Lakehouse Engine is a configuration driven Spark framework, written in Python, serving as a scalable and distributed engine for sever…
  ☆240Updated last month
• Data-Engineer-Camp / dbt-dimensional-modelling
  Step-by-step tutorial on building a Kimball dimensional model with dbt
  ☆135Updated 8 months ago
• mrpowers-io / spark-style-guide
  Spark style guide
  ☆258Updated 6 months ago
• cordon-thiago / airflow-spark
  Docker with Airflow and Spark standalone cluster
  ☆253Updated last year
• dipankarmazumdar / awesome-lakehouse-guide
  Repo for everything open table formats (Iceberg, Hudi, Delta Lake) and the overall Lakehouse architecture
  ☆60Updated 2 months ago
• PatrickCuba / the_data_must_flow
  ☆28Updated this week
• josephmachado / simple_dbt_project
  Code for dbt tutorial
  ☆155Updated 10 months ago
• newfront / hitchhikers_guide_to_deltalake_streaming
  Don't Panic. This guide will help you when it feels like the end of the world.
  ☆23Updated 9 months ago
• erika-e / dbt-tips
  Collection of dbt Tips and Tricks
  ☆384Updated 2 years ago