A repo to track data engineering projects
☆14Nov 11, 2022Updated 3 years ago
Alternatives and similar repositories for dataEngineering
Users that are interested in dataEngineering are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A production-grade data pipeline has been designed to automate the parsing of user search patterns to analyze user engagement. Extract d…☆24Nov 22, 2021Updated 4 years ago
- Project based learning for Data Engineering fundamentals.☆13Jan 15, 2021Updated 5 years ago
- A collection of data engineering projects: data modeling, ETL pipelines, data lakes, infrastructure configuration on AWS, data warehousin…☆15Apr 29, 2021Updated 5 years ago
- DataTalks.Club's Data Engineering Zoomcamp Project☆12May 7, 2023Updated 3 years ago
- 😈Complete End to End ETL Pipeline with Spark, Airflow, & AWS☆49Aug 23, 2019Updated 7 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Example project for consuming AWS Kinesis streamming and save data on Amazon Redshift using Apache Spark☆11May 22, 2018Updated 8 years ago
- A batch Data Pipeline that retrieves data from a user purchase table and a movie review table and is transformed to form a user behaviour…☆18Aug 14, 2025Updated last year
- This repo has some proposed agenda for Azure Machine Learning related hands-on workshops.☆11Feb 2, 2021Updated 5 years ago
- A podcast transcription service built on Azure that transcribes any new episode of your podcast and displays synchronized transcripts alo…☆10Dec 10, 2022Updated 3 years ago
- Some example projects for Data Engineers to build, end-to-end.☆39Nov 8, 2023Updated 2 years ago
- Data Engineering, Data Warehouse, Data Mart, Cloud Data, AWS, SAS, Redshift, S3☆36Feb 2, 2021Updated 5 years ago
- Data Engineering Project in GCP☆23Mar 29, 2023Updated 3 years ago
- Data models, build data warehouses and data lakes, automate data pipelines, and worked with massive datasets.☆12Jul 16, 2019Updated 7 years ago
- Chrome Extension for Development/Testing/Exploring GraphQL Servers☆14Oct 1, 2018Updated 8 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A data engineering project with Airflow, dbt, Terrafrom, GCP and much more!☆28Nov 8, 2022Updated 3 years ago
- ☆10May 24, 2021Updated 5 years ago
- Some code samples showing differences between Fabric8 and Official Java Client☆11Aug 13, 2024Updated 2 years ago
- Candidate solution for Facebook's fake news problem using machine learning and crowd-sourcing. Takes form of a Chrome extension. Develope…☆13Aug 25, 2017Updated 9 years ago
- Setup an ETL from Twitter API to S3☆10Nov 20, 2020Updated 5 years ago
- Collection Of All Python Notebooks Shared On Twitter☆11Apr 10, 2023Updated 3 years ago
- Examples of all Machine Learning Algorithm in Apache Spark☆15Nov 2, 2017Updated 8 years ago
- DataTalks.Club's Data Engineering Zoomcamp Project☆25Jul 14, 2022Updated 4 years ago
- In this project, we will build and ETL(Extract,Transform,Load) pipeline using the Spotify API on AWS. The pipeline will retrieve data fro…☆25May 6, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Insight Data Engineering project: A platform built in HDFS, Spark and Airflow to help you to find social influencers from GitHub Net…☆16May 21, 2024Updated 2 years ago
- A project portfolio to accompany my resume☆32Sep 5, 2023Updated 3 years ago
- ☆30Nov 16, 2023Updated 2 years ago
- Source code for the Modern Golang Programming course☆10Jul 6, 2017Updated 9 years ago
- A real time analytics dashboard to analyze the trending hashtags and @ mentions at any location using kafka and spark streaming.☆21Oct 15, 2024Updated 2 years ago
- Code for my blogs on Data Engineering☆14Nov 9, 2020Updated 5 years ago
- ☆13Dec 28, 2023Updated 2 years ago
- ☆10Jun 22, 2020Updated 6 years ago
- GRPC implementation over springboot☆11Sep 6, 2019Updated 7 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- COMP9321 Data Services Engineering 2019T1☆10Jun 4, 2019Updated 7 years ago
- Interact to smart contract on Ropsten Test Network Ethereum using Golang☆12May 31, 2019Updated 7 years ago
- Pipeline, warehouse, and visualization tools for investigating the impact of Airbnb short-term rentals on world cities.☆16Jun 9, 2023Updated 3 years ago
- Learn Scala Fundamentals by creating a working bank!☆15Jan 22, 2019Updated 7 years ago
- Terraform Module to create a Apache Spark cluster on AWS☆16Jan 3, 2022Updated 4 years ago
- Use the Google Cloud Speech API to transcribe audio files from a podcast.☆21May 17, 2017Updated 9 years ago
- You can automate the process of building, testing, delivering, or deploying your Machine Learning models into production using GitHub Act…☆12Jun 13, 2020Updated 6 years ago