Data Pipeline that utilizes GCP, Python 3.10, Prefect, and more.
☆10Jan 23, 2023Updated 3 years ago
Alternatives and similar repositories for crypto-data-pipeline
Users that are interested in crypto-data-pipeline are comparing it to the libraries listed below
Sorting:
- Data transformation and manipulation tool.☆12Mar 20, 2023Updated 3 years ago
- ☆13Oct 17, 2024Updated last year
- Run an open-source data LakeHouse locally using Docker Compose☆12May 31, 2024Updated last year
- An end to end ML project. Using MLflow for experiment tracking and model registry. Prefect for workflow orchestration. S3 for artifacts s…☆12Sep 11, 2022Updated 3 years ago
- ☆15Oct 9, 2018Updated 7 years ago
- This is the end to end MLOps project I built through participated the MLOps Zoomcamp☆10Sep 11, 2022Updated 3 years ago
- Prefect integrations with Slack☆22Apr 26, 2024Updated last year
- Files for the Docker and Kubernetes on Google Cloud Hands-On labs☆11Mar 14, 2023Updated 3 years ago
- Scrapping and analyzing TikTok videos☆11Feb 19, 2023Updated 3 years ago
- An event streaming pipeline built using Kafka, KSQL, Faust, and Spark Structured Streaming☆11Sep 12, 2020Updated 5 years ago
- CalData's MDSA project with Caltrans on Performance Measurement System (PeMS) data☆12Aug 19, 2025Updated 7 months ago
- ☆15Jan 21, 2026Updated last month
- ☆14Aug 6, 2023Updated 2 years ago
- KnetBuilder data integration platform for building knowledge graphs. Previously known as ondex.☆15Aug 27, 2025Updated 6 months ago
- Simulate SDTM datasets in SAS.☆12Jan 19, 2018Updated 8 years ago
- ☆16Mar 3, 2026Updated 2 weeks ago
- Repository template to get started with Prefect Cloud & Google Cloud☆24Feb 9, 2023Updated 3 years ago
- CI/CD repository template to automate deployments of your production flows☆14Jul 1, 2024Updated last year
- Plugin to orchestrate custom scripts in any language including Python, Node.js, R, Shell, PowerShell, and more.☆18Updated this week
- VSCode extension to bring Kestra's autocompletion to your IDE☆13Sep 29, 2025Updated 5 months ago
- trino monitoring with JMX metrics through Prometheus and Grafana☆17Aug 14, 2024Updated last year
- A Firebase Cloud Function and a Firebase hosted web app to treat weather data collected by Cloud IoT Core☆18Mar 10, 2019Updated 7 years ago
- Knowledge management meets spaced repetition.☆29Mar 13, 2026Updated last week
- Type stubs for the Google Ads API Client Library for Python☆13Feb 14, 2026Updated last month
- An end-to-end data pipeline which extracts divvy bikeshare data from web loads it into data lake and datawarehouse transforms it using db…☆36Apr 29, 2023Updated 2 years ago
- Short Range Ultrasonic Radar - A simple radar using the ultrasonic sensor, this radar works by measuring a range from 3cm to 40 cm as non…☆19Nov 11, 2024Updated last year
- Prefect tasks and subflows for interacting with email☆32Apr 26, 2024Updated last year
- Spark-based pipeline to extract and parse monthly games from the Lichess database.☆21Sep 22, 2025Updated 5 months ago
- In this project I have built etl pipline which scraps the trending repository based on month,week and day LIVE extract other related info…☆12Sep 9, 2023Updated 2 years ago
- Prefect integrations with SQLAlchemy.☆25Apr 26, 2024Updated last year
- Automate data collection from Spotify's worldwide ranking in 50+ countries☆24May 3, 2020Updated 5 years ago
- Create pie charts to see the most dominant miners over the history of Bitcoin.☆13Apr 8, 2021Updated 4 years ago
- This github action automatically formats your golang files and pushes them to your repo☆11Nov 2, 2025Updated 4 months ago
- End-to-End deployment of E-commerce customers segmentation using Clustering Machine learning algorithms in Google Cloud Platform and MLOp…☆20Jun 5, 2024Updated last year
- Plugin to use Terraform with Kestra☆23Mar 2, 2026Updated 2 weeks ago
- ☆39Dec 3, 2024Updated last year
- A place to put the code samples of my Python Friday blog series https://improveandrepeat.com/category/pythonfriday/☆26Mar 11, 2026Updated last week
- Sample code and documentation for very basic things that I can't remember but want to aggregate in one place☆13Nov 7, 2021Updated 4 years ago
- Date-related macros for dbt☆26Jan 16, 2026Updated 2 months ago