Alternatives and similar repositories for stream-ingestion-redpanda-minio:

Users that are interested in stream-ingestion-redpanda-minio are comparing it to the libraries listed below

• pyjaime / docker-airflow-spark
  Docker with Airflow + Postgres + Spark cluster + JDK (spark-submit support) + Jupyter Notebooks
  ☆21Updated 2 years ago
• hnawaz007 / dbt-dw
  build dw with dbt
  ☆33Updated 2 months ago
• josephmachado / online_store
  End to end data engineering project
  ☆53Updated 2 years ago
• arezamoosavi / AcidOnSpark-ETL
  Delta-Lake, ETL, Spark, Airflow
  ☆45Updated 2 years ago
• SebasMBK / SunglassesHubETL
  This project is for demonstrating knowledge of Data Engineering tools and concepts and also learning in the process
  ☆45Updated 2 years ago
• jonathanneo / databricks-unit-testing
  Unit testing using databricks connect
  ☆30Updated 3 years ago
• martandsingh / ApacheSpark
  This repository will help you to learn about databricks concept with the help of examples. It will include all the important topics which…
  ☆95Updated 5 months ago
• Stefen-Taime / Iceberg-Dbt-Trino-Hive-modern-open-source-data-stack
  To provide a deeper understanding of how the modern, open-source data stack consisting of Iceberg, dbt, Trino, and Hive operates within a…
  ☆30Updated 10 months ago
• PacktPublishing / Data-engineering-with-dbt
  Data engineering with dbt, published by Packt
  ☆66Updated 10 months ago
• JesusAcuna / data-engineering-project
  ☆28Updated last year
• kaoutaar / end-to-end-etl-pipeline-jcdecaux-API
  velib-v2: An ETL pipeline that employs batch and streaming jobs using Spark, Kafka, Airflow, and other tools, all orchestrated with Docke…
  ☆18Updated 4 months ago
• CodyAustinDavis / edw-best-practices
  Git Repo for EDW Best Practice Assets on the Lakehouse
  ☆15Updated last year
• yTek01 / docker-spark-airflow
  ☆34Updated last year
• danielbeach / dataEngineeringTemplate
  Template for Data Engineering and Data Pipeline projects
  ☆106Updated 2 years ago
• Stefen-Taime / modern-data-pipeline
  reating a modern data pipeline using a combination of Terraform, AWS Lambda and S3, Snowflake, DBT, Mage AI, and Dash.
  ☆13Updated last year
• le-oasis / docker-airflow-spark
  Building a Modern Data Lake with Minio, Spark, Airflow via Docker.
  ☆16Updated 8 months ago
• itversity / data-engineering-spark
  ☆86Updated 2 years ago
• subhamkharwal / ease-with-apache-spark
  Series follows learning from Apache Spark (PySpark) with quick tips and workaround for daily problems in hand
  ☆45Updated last year
• airscholar / modern-data-eng-dbt-databricks-azure
  In this project, we setup and end to end data engineering using Apache Spark, Azure Databricks, Data Build Tool (DBT) using Azure as our …
  ☆24Updated last year
• alexott / dlt-files-in-repos-demo
  Demonstration of using Files in Repos with Databricks Delta Live Tables
  ☆30Updated 6 months ago
• raveendratal / ravi_azureadbadf
  Ravi Azure ADB ADF Repository
  ☆65Updated last month
• dogukannulu / airflow_kafka_cassandra_mongodb
  Produce Kafka messages, consume them and upload into Cassandra, MongoDB.
  ☆39Updated last year
• josephmachado / simple_dbt_project
  Code for dbt tutorial
  ☆149Updated 7 months ago
• calbergs / spotify-api
  Pipeline that extracts data from the Spotify API to build a more detailed version of Spotify Wrapped
  ☆32Updated last year
• ryanchynoweth44 / DatabricksContent
  Examples surrounding Databricks.
  ☆57Updated 6 months ago
• jacob1421 / RustCheatersDataPipeline
  Data pipeline that scrapes Rust cheater Steam profiles
  ☆51Updated 2 years ago
• ankurchavda / data-engineering-zoomcamp
  A course by DataTalks Club that covers Spark, Kafka, Docker, Airflow, Terraform, DBT, Big Query etc
  ☆14Updated 2 years ago
• delta-io / delta-examples
  Delta Lake examples
  ☆214Updated 3 months ago