nama1arpit / reddit-streaming-pipeline

Related projects ⓘ

Alternatives and complementary repositories for reddit-streaming-pipeline

• jacob1421 / RustCheatersDataPipeline
  Data pipeline that scrapes Rust cheater Steam profiles
  ☆50Updated 2 years ago
• josephmachado / efficient_data_processing_spark
  Code for "Efficient Data Processing in Spark" Course
  ☆239Updated last month
• josephmachado / data_engineering_best_practices
  Sample project to demonstrate data engineering best practices
  ☆163Updated 8 months ago
• ris-tlp / audiophile-e2e-pipeline
  Pipeline that extracts data from Crinacle's Headphone and InEarMonitor databases and finalizes data for a Metabase Dashboard.
  ☆195Updated last year
• josephmachado / data_engineering_project_template
  A template repository to create a data project with IAC, CI/CD, Data migrations, & testing
  ☆237Updated 3 months ago
• digitalghost-dev / premier-league
  A Data Engineering project. Repository for backend infrastructure and Streamlit app files for a Premier League Dashboard.
  ☆211Updated 5 months ago
• josephmachado / socialetl
  Project for "Data pipeline design patterns" blog.
  ☆41Updated 3 months ago
• josephmachado / simple_dbt_project
  Code for dbt tutorial
  ☆143Updated 5 months ago
• calbergs / spotify-api
  Pipeline that extracts data from the Spotify API to build a more detailed version of Spotify Wrapped
  ☆31Updated 11 months ago
• danielbeach / dataEngineeringTemplate
  Template for Data Engineering and Data Pipeline projects
  ☆104Updated last year
• kaoutaar / end-to-end-etl-pipeline-jcdecaux-API
  velib-v2: An ETL pipeline that employs batch and streaming jobs using Spark, Kafka, Airflow, and other tools, all orchestrated with Docke…
  ☆18Updated last month
• sidharth1805 / Spotify_etl
  ☆126Updated last year
• josephmachado / adv_data_transformation_in_sql
  Code for "Advanced data transformations in SQL" free live workshop
  ☆64Updated 2 weeks ago
• EcZachly / little-book-of-pipelines
  This repository goes over how to handle massive variety in data engineering
  ☆93Updated last year
• josephmachado / beginner_de_project_stream
  Simple stream processing pipeline
  ☆91Updated 4 months ago
• Data-Engineer-Camp / dbt-dimensional-modelling
  Step-by-step tutorial on building a Kimball dimensional model with dbt
  ☆109Updated 3 months ago
• davidzajac1 / zillacode
  Open Source LeetCode for PySpark, Spark, Pandas and DBT/Snowflake
  ☆97Updated 2 months ago
• andrem8 / surf_dash
  ☆128Updated 2 years ago
• ABZ-Aaron / Reddit-API-Pipeline
  ☆306Updated 2 months ago
• josephmachado / de_project
  Step by step instructions to create a production-ready data pipeline
  ☆25Updated last month
• seacevedo / Solana-Pipeline
  Data Engineering Project to Extract and Process Solana Reddit Data
  ☆22Updated 9 months ago
• josephmachado / bitcoinMonitor
  Near real time ETL to populate a dashboard.
  ☆70Updated 4 months ago
• josephmachado / change_data_capture
  Repo for CDC with debezium blog post
  ☆26Updated last month
• josephmachado / analytical_dp_with_sql
  Code for my "Efficient Data Processing in SQL" book.
  ☆49Updated 3 months ago
• jackgisby / tfl-bikes-data-pipeline
  Processing TfL data for bike usage with Google Cloud Platform.
  ☆42Updated 2 years ago
• data-engineering-community / data-engineering-project-template
  This is a template you can use for your next data engineering portfolio project.
  ☆160Updated 3 years ago
• abdkumar / spotify-stream-analytics
  Generate synthetic Spotify music stream dataset to create dashboards. Spotify API generates fake event data emitted to Kafka. Spark consu…
  ☆66Updated 10 months ago
• iamraphson / DE-2024-project-book-recommendation
  ☆21Updated 7 months ago
• ANelson82 / de_zoomcamp_2022_earthquake_capstone
  ☆16Updated last year
• josephmachado / python_essentials_for_data_engineers
  Code for blog at https://www.startdataengineering.com/post/python-for-de/
  ☆55Updated 5 months ago