chuqiaoshen / Git-InfluencerLinks
Insight Data Engineering project: A platform built in HDFS, Spark and Airflow to help you to find social influencers from GitHub Network.
☆16Updated last year
Alternatives and similar repositories for Git-Influencer
Users that are interested in Git-Influencer are comparing it to the libraries listed below
Sorting:
- Simplified ETL process in Hadoop using Apache Spark. Has complete ETL pipeline for datalake. SparkSession extensions, DataFrame validatio…☆55Updated 2 years ago
- Udacity Data Pipeline Exercises☆15Updated 5 years ago
- 🚨 Simple, self-contained fraud detection system built with Apache Kafka and Python☆87Updated 6 years ago
- Basic tutorial of using Apache Airflow☆36Updated 6 years ago
- Blog post on ETL pipelines with Airflow☆23Updated 5 years ago
- Slowly Changing Dimension type 2 using Hive query language using exclusive join technique with ORC Hive tables, partitioned and clustered…☆16Updated 6 years ago
- A way for home buyers to know about factors affecting a state☆48Updated 6 years ago
- A real-time event pipeline around Kafka Ecosystem for Chicago Transit Authority.☆31Updated last year
- Mastering Spark for Data Science, published by Packt☆47Updated 2 years ago
- ☆18Updated 2 months ago
- A full data warehouse infrastructure with ETL pipelines running inside docker on Apache Airflow for data orchestration, AWS Redshift for …☆137Updated 5 years ago
- This repository hosts the code/projects/demos/slides for Big Data technologies under Apache Hadoop and Apache Spark umbrella.☆42Updated 2 years ago
- Because its never late to start taking notes and 'public' it...☆59Updated 3 weeks ago
- AWS Big Data Certification☆25Updated 5 months ago
- JobAnalytics system consumes data from multiple sources and provides valuable information to both job hunters and recruiters.☆31Updated 2 years ago
- Jupyter notebooks for pyspark tutorials given at University☆108Updated 6 months ago
- Full stack data engineering tools and infrastructure set-up☆53Updated 4 years ago
- ☆10Updated 6 years ago
- Public repository for the Search Fundamentals course taught by Daniel Tunkelang and Grant Ingersoll. Available at https://corise.com/cour…☆44Updated last year
- Small data engineering tutorial☆10Updated 6 years ago
- Challenge for those applying to the Software Engineer, Big Data position☆35Updated 13 years ago
- ☆17Updated 6 years ago
- Design/Implement stream/batch architecture on NYC taxi data | #DE☆25Updated 4 years ago
- Supplementary material for Building a Modern Data Platform with Snowflake, from Pearson.☆20Updated 3 years ago
- ☆16Updated this week
- A repository for a PySpark Cookbook by Tomasz Drabas and Denny Lee☆59Updated 6 years ago
- Skeleton project for Apache Airflow training participants to work on.☆16Updated 4 years ago
- Public source code for the Batch Processing with Apache Beam (Python) online course☆18Updated 4 years ago
- Developed a data pipeline to automate data warehouse ETL by building custom airflow operators that handle the extraction, transformation,…☆90Updated 3 years ago
- Apache Spark Interview Question and Answers☆21Updated 4 years ago