Data pipeline that scrapes Rust cheater Steam profiles
☆53Feb 13, 2022Updated 4 years ago
Alternatives and similar repositories for RustCheatersDataPipeline
Users that are interested in RustCheatersDataPipeline are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Processing TfL data for bike usage with Google Cloud Platform.☆45Jul 15, 2022Updated 4 years ago
- Data Engineer Roadmaps as Projects Funnel☆12Aug 10, 2022Updated 4 years ago
- Educational project on how to build an ETL (Extract, Transform, Load) data pipeline, orchestrated with Airflow.☆352Jan 12, 2022Updated 4 years ago
- I am using confluent Kafka cluster to produce and consume scraped data. In this project, I've created a real-time data pipeline that uti…☆29May 2, 2023Updated 3 years ago
- velib-v2: An ETL pipeline that employs batch and streaming jobs using Spark, Kafka, Airflow, and other tools, all orchestrated with Docke…☆21Aug 12, 2025Updated 11 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Bunch of Airflow Configurations and DAGs for Kubernetes, Spark based data-pipelines. Scale inside Kubernetes using spark kubernetes maste…☆23Feb 22, 2022Updated 4 years ago
- An end-to-end data engineering pipeline to create a dashboard for the latest content on the r/Stocks subreddit☆20Aug 5, 2022Updated 4 years ago
- Data models, build data warehouses and data lakes, automate data pipelines, and worked with massive datasets.☆12Jul 16, 2019Updated 7 years ago
- Pipeline that extracts data from the Spotify API to build a more detailed version of Spotify Wrapped☆50Jul 26, 2026Updated 2 weeks ago
- Stream/batch system with Hadoop, Spark on NYC taxi data | #DE☆26Apr 10, 2026Updated 4 months ago
- ☆402Jan 26, 2025Updated last year
- Pipeline that extracts data from Crinacle's Headphone and InEarMonitor databases and finalizes data for a Metabase Dashboard. The dashboa…☆270Jan 1, 2023Updated 3 years ago
- A data engineering project with Airflow, dbt, Terrafrom, GCP and much more!☆28Nov 8, 2022Updated 3 years ago
- Demo for GitHub Universe 2022☆13Jan 31, 2023Updated 3 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ⚡️ Pandas dataframes with object oriented programming style (not maintained)☆11Mar 17, 2024Updated 2 years ago
- Resources and projects from Udacity Data Engineering with AWS nano degree programme☆30Apr 12, 2023Updated 3 years ago
- Simple ETL pipeline using Python☆29May 22, 2023Updated 3 years ago
- A data engineering project with Kafka, Spark Streaming, dbt, Docker, Airflow, Terraform, GCP and much more!☆894Apr 16, 2022Updated 4 years ago
- ☆177May 20, 2022Updated 4 years ago
- Use AWS Lambda to Pull E-Scooter and E-Bike Location Data, store in S3 & Redshift using Data Vault Data Model, Server to Google Data Stud…☆16Jun 12, 2022Updated 4 years ago
- A shell script to automate the operations of sqoop☆11Mar 29, 2021Updated 5 years ago
- Repo for orienting dbt users to the Dagster asset framework☆56Oct 24, 2022Updated 3 years ago
- Data Engineering pipeline hosted entirely in the AWS ecosystem utilizing DocumentDB as the database☆14Oct 26, 2021Updated 4 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A template repository to create a data project with IAC, CI/CD, Data migrations, & testing☆298Jul 11, 2024Updated 2 years ago
- Capstone project for mlops zoomcamp☆11Sep 12, 2022Updated 3 years ago
- This project focuses on building a robust data pipeline using Apache Airflow to automate the ingestion of weather data from the OpenWeath…☆22Feb 3, 2026Updated 6 months ago
- ☆16May 29, 2023Updated 3 years ago
- A demonstration of an ELT (Extract, Load, Transform) pipeline☆32Feb 19, 2024Updated 2 years ago
- ☆11Nov 18, 2022Updated 3 years ago
- The practical use-cases of how to make your Machine Learning Pipelines robust and reliable using Apache Airflow.☆51Dec 8, 2022Updated 3 years ago
- A real-time reddit data streaming pipeline for sentiment analysis of various subreddits☆147Aug 23, 2023Updated 2 years ago
- Data Engineering Bootcamp☆34Updated this week
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- Full-stack OpenTelemetry observability for Apache Spark☆16Aug 2, 2026Updated last week
- My Insight Data Engineering Fellowship project. I implemented a big data processing pipeline based on lambda architecture, that aggrega…☆508Aug 24, 2022Updated 3 years ago
- Source code of webpro.nl☆11Oct 12, 2025Updated 9 months ago
- This repository contains a Docker Compose configuration for running ScyllaDB, a highly scalable NoSQL database for learning and testing.☆13Sep 19, 2024Updated last year
- ☆15Jun 7, 2024Updated 2 years ago
- Master's thesis on Big Data☆36Aug 14, 2022Updated 3 years ago
- My solutions for the Udacity Data Engineering Nanodegree☆34Oct 14, 2019Updated 6 years ago