Alternatives and similar repositories for posts

Users that are interested in posts are comparing it to the libraries listed below

• EcZachly / microbatch-hourly-deduped-tutorial
  ☆120Updated 6 months ago
• ismaildawoodjee / aws-data-pipeline
  A batch processing data pipeline, using AWS resources (S3, EMR, Redshift, EC2, IAM), provisioned via Terraform, and orchestrated from loc…
  ☆23Updated 3 years ago
• itversity / data-engineering-spark
  ☆88Updated 3 years ago
• dogukannulu / airflow_kafka_cassandra_mongodb
  Produce Kafka messages, consume them and upload into Cassandra, MongoDB.
  ☆43Updated 2 years ago
• mharty3 / energy_data_capstone
  ☆36Updated 2 years ago
• dogukannulu / kafka_spark_structured_streaming
  Get data from API, run a scheduled script with Airflow, send data to Kafka and consume with Spark, then write to Cassandra
  ☆144Updated 2 years ago
• dogukannulu / streaming_data_processing
  Create a streaming data, transfer it to Kafka, modify it with PySpark, take it to ElasticSearch and MinIO
  ☆65Updated 2 years ago
• subhamkharwal / ease-with-apache-spark
  Series follows learning from Apache Spark (PySpark) with quick tips and workaround for daily problems in hand
  ☆56Updated 2 years ago
• simardeep1792 / Data-Engineering-Streaming-Project
  ☆45Updated last year
• danielbeach / dataEngineeringTemplate
  Template for Data Engineering and Data Pipeline projects
  ☆116Updated 3 years ago
• shivampanicker / cicd_with_databricks
  ☆30Updated last year
• josephmachado / simple_dbt_project
  Code for dbt tutorial
  ☆166Updated 4 months ago
• jackgisby / tfl-bikes-data-pipeline
  Processing TfL data for bike usage with Google Cloud Platform.
  ☆46Updated 3 years ago
• jamesdensmore / datapipelinesbook
  ☆193Updated 4 years ago
• EcZachly / video-game-training-sql
  Hey this is the repo that has all the queries and data for my video game training series!
  ☆155Updated 3 years ago
• PacktPublishing / Essential-PySpark-for-Scalable-Data-Analytics
  Essential PySpark for Scalable Data Analytics, published by Packt
  ☆46Updated 3 years ago
• danieldiamond / data-engineering-capstone
  Data Engineering Capstone Project: ETL Pipelines and Data Warehouse Development
  ☆21Updated 6 years ago
• AISCIENCES / course-master-big-data-with-pyspark-and-aws
  Master Big Data With PySpark and AWS
  ☆132Updated 2 years ago
• TJaniF / airflow-elt-blueprint
  A self-contained, ready to run Airflow ELT project. Can be run locally or within codespaces.
  ☆80Updated 2 years ago
• noahgift / databricks-zero-to-mlops
  ☆28Updated 3 years ago
• hyunjoonbok / PySpark
  PySpark functions and utilities with examples. Assists ETL process of data modeling
  ☆104Updated 5 years ago
• josephmachado / analytical_dp_with_sql
  Code for my "Efficient Data Processing in SQL" book.
  ☆60Updated last year
• josephmachado / beginner_de_project_stream
  Simple stream processing pipeline
  ☆110Updated last year
• datarootsio / tutorial-great-expectations
  A tutorial for the Great Expectations library.
  ☆72Updated 4 years ago
• josephmachado / e2e_datapipeline_test
  Example repo to create end to end tests for data pipeline.
  ☆25Updated last year
• guoliveira / data-engineer-zoomcamp-project
  ☆42Updated 2 years ago
• danielbeach / unitTestPySpark
  how to unit test your PySpark code
  ☆29Updated 4 years ago
• HamzaG737 / data-engineering-project
  End to end data engineering project with kafka, airflow, spark, postgres and docker.
  ☆107Updated 3 weeks ago
• josephmachado / adv_data_transformation_in_sql
  Code for "Advanced data transformations in SQL" free live workshop
  ☆89Updated 8 months ago
• hnawaz007 / pythondataanalysis
  Python data repo, jupyter notebook, python scripts and data.
  ☆547Updated last year