Data pipeline that scrapes Rust cheater Steam profiles
☆53Feb 13, 2022Updated 4 years ago
Alternatives and similar repositories for RustCheatersDataPipeline
Users that are interested in RustCheatersDataPipeline are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Processing TfL data for bike usage with Google Cloud Platform.☆45Jul 15, 2022Updated 4 years ago
- Data Engineer Roadmaps as Projects Funnel☆12Aug 10, 2022Updated 3 years ago
- Educational project on how to build an ETL (Extract, Transform, Load) data pipeline, orchestrated with Airflow.☆351Jan 12, 2022Updated 4 years ago
- I am using confluent Kafka cluster to produce and consume scraped data. In this project, I've created a real-time data pipeline that uti…☆29May 2, 2023Updated 3 years ago
- This project involves an ETL (Extract, Transform, Load) process to analyze sleep data exported from Apple Health☆29Apr 29, 2023Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- velib-v2: An ETL pipeline that employs batch and streaming jobs using Spark, Kafka, Airflow, and other tools, all orchestrated with Docke…☆21Aug 12, 2025Updated 11 months ago
- In this project, we will build and ETL(Extract,Transform,Load) pipeline using the Spotify API on AWS. The pipeline will retrieve data fro…☆25May 6, 2023Updated 3 years ago
- Bunch of Airflow Configurations and DAGs for Kubernetes, Spark based data-pipelines. Scale inside Kubernetes using spark kubernetes maste…☆23Feb 22, 2022Updated 4 years ago
- Data models, build data warehouses and data lakes, automate data pipelines, and worked with massive datasets.☆12Jul 16, 2019Updated 7 years ago
- Pipeline that extracts data from the Spotify API to build a more detailed version of Spotify Wrapped☆50Jun 7, 2026Updated last month
- Stream/batch system with Hadoop, Spark on NYC taxi data | #DE☆26Apr 10, 2026Updated 3 months ago
- ☆402Jan 26, 2025Updated last year
- Pipeline that extracts data from Crinacle's Headphone and InEarMonitor databases and finalizes data for a Metabase Dashboard. The dashboa…☆270Jan 1, 2023Updated 3 years ago
- A data engineering project with Airflow, dbt, Terrafrom, GCP and much more!☆27Nov 8, 2022Updated 3 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- This is a simple Linear Regression implementation machine learning model and deployment of the same using flask. Data-set of Vadodara Hou…☆10Jan 8, 2020Updated 6 years ago
- Demo for GitHub Universe 2022☆13Jan 31, 2023Updated 3 years ago
- Resources and projects from Udacity Data Engineering with AWS nano degree programme☆29Apr 12, 2023Updated 3 years ago
- A data engineering project with Kafka, Spark Streaming, dbt, Docker, Airflow, Terraform, GCP and much more!☆889Apr 16, 2022Updated 4 years ago
- A shell script to automate the operations of sqoop☆11Mar 29, 2021Updated 5 years ago
- Repo for orienting dbt users to the Dagster asset framework☆56Oct 24, 2022Updated 3 years ago
- ☆11Jul 14, 2022Updated 4 years ago
- Data Engineering pipeline hosted entirely in the AWS ecosystem utilizing DocumentDB as the database☆14Oct 26, 2021Updated 4 years ago
- A template repository to create a data project with IAC, CI/CD, Data migrations, & testing☆296Jul 11, 2024Updated 2 years ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆12Mar 23, 2019Updated 7 years ago
- Capstone project for mlops zoomcamp☆11Sep 12, 2022Updated 3 years ago
- This project focuses on building a robust data pipeline using Apache Airflow to automate the ingestion of weather data from the OpenWeath…☆22Feb 3, 2026Updated 5 months ago
- ☆16May 29, 2023Updated 3 years ago
- Real-time streaming data pipeline for Twitter Tweets☆10Jan 31, 2022Updated 4 years ago
- Tracking and measuring neighborhood and district-level eviction rates in the city of San Francisco.☆140Jul 14, 2020Updated 6 years ago
- A demonstration of an ELT (Extract, Load, Transform) pipeline☆32Feb 19, 2024Updated 2 years ago
- RedditR for Content Engagement and Recommendation☆18Dec 21, 2017Updated 8 years ago
- ☆11Nov 18, 2022Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- The practical use-cases of how to make your Machine Learning Pipelines robust and reliable using Apache Airflow.☆51Dec 8, 2022Updated 3 years ago
- A real-time reddit data streaming pipeline for sentiment analysis of various subreddits☆148Aug 23, 2023Updated 2 years ago
- ☆215Aug 13, 2023Updated 2 years ago
- Data Engineering Bootcamp☆33Aug 5, 2025Updated 11 months ago
- Full-stack OpenTelemetry observability for Apache Spark☆16Feb 28, 2026Updated 4 months ago
- Docktor is a Web App that deploys an easy-to-use kit of analysis and scanning tools.☆14Nov 1, 2023Updated 2 years ago
- Tutorial and examples of Data Quality in Big Data System☆11Apr 25, 2017Updated 9 years ago