JawaharRamis / reddit-streaming-kafka-spark-applicationLinks
☆9Updated last year
Alternatives and similar repositories for reddit-streaming-kafka-spark-application
Users that are interested in reddit-streaming-kafka-spark-application are comparing it to the libraries listed below
Sorting:
- velib-v2: An ETL pipeline that employs batch and streaming jobs using Spark, Kafka, Airflow, and other tools, all orchestrated with Docke…☆19Updated 8 months ago
- A self-contained, ready to run Airflow ELT project. Can be run locally or within codespaces.☆69Updated last year
- Code for dbt tutorial☆157Updated this week
- Code for my "Efficient Data Processing in SQL" book.☆56Updated 10 months ago
- Code snippets for Data Engineering Design Patterns book☆116Updated 2 months ago
- build dw with dbt☆45Updated 7 months ago
- Code for "Advanced data transformations in SQL" free live workshop☆81Updated last month
- Step-by-step tutorial on building a Kimball dimensional model with dbt☆140Updated 10 months ago
- Cost Efficient Data Pipelines with DuckDB☆53Updated 3 weeks ago
- A demonstration of an ELT (Extract, Load, Transform) pipeline☆29Updated last year
- A dbt (data build tool) project you can use for testing purposes or experimentation☆36Updated last year
- ☆131Updated 3 months ago
- End to end data engineering project☆56Updated 2 years ago
- A curated list of awesome public DBT projects☆134Updated last year
- Building Data Lakehouse by open source technology. Support end to end data pipeline, from source data on AWS S3 to Lakehouse, visualize a…☆27Updated last year
- Just starting your DE journey or along the way already?. I will be sharing a short list of DATA-ENGINEERING-CENTRED books that covers the…☆34Updated 2 years ago
- Project for "Data pipeline design patterns" blog.☆45Updated 10 months ago
- Repo for saving cheat sheets☆56Updated last year
- To provide a deeper understanding of how the modern, open-source data stack consisting of Iceberg, dbt, Trino, and Hive operates within a…☆35Updated last year
- Sample project to demonstrate data engineering best practices☆192Updated last year
- A write-audit-publish implementation on a data lake without the JVM☆46Updated 9 months ago
- New generation opensource data stack☆68Updated 3 years ago
- Repo for CDC with debezium blog post☆28Updated 8 months ago
- ☆31Updated last year
- Local Environment to Practice Data Engineering☆142Updated 5 months ago
- Data pipeline that scrapes Rust cheater Steam profiles☆51Updated 3 years ago
- In this project, we setup and end to end data engineering using Apache Spark, Azure Databricks, Data Build Tool (DBT) using Azure as our …☆31Updated last year
- ☆80Updated 7 months ago
- A batch processing data pipeline, using AWS resources (S3, EMR, Redshift, EC2, IAM), provisioned via Terraform, and orchestrated from loc…☆22Updated 3 years ago
- Sample Data Lakehouse deployed in Docker containers using Apache Iceberg, Minio, Trino and a Hive Metastore. Can be used for local testin…☆71Updated last year