My own ETL pipeline of random users utilising Postgres for long term storage and Redis for caching. Served up via FastAPI and Docker
☆31Oct 22, 2024Updated last year
Alternatives and similar repositories for etl-pipeline
Users that are interested in etl-pipeline are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- I saw this [Blog Post](https://www.morling.dev/blog/one-billion-row-challenge/) on a Billion Row challenge for Java so naturally I tried …☆14Jan 10, 2024Updated 2 years ago
- Data Engineering with Scala, published by Packt☆28Apr 22, 2026Updated 2 months ago
- ⚙️ Airflow data pipeline with Terraform, GCP BigQuery, dbt, Soda and Looker Studio.☆26Oct 19, 2023Updated 2 years ago
- FInal project for data zoom camp 2024☆17Mar 31, 2024Updated 2 years ago
- Docker with N8N selfhosted and postgresql with caddy.☆21Apr 23, 2026Updated 2 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Repository containing projects and summaries of my studies in the field of Data Engineering.☆55May 22, 2026Updated last month
- Analyzes spending, budget, and investment data in a CLI using Python☆18Jun 19, 2026Updated last week
- ☆10Jul 17, 2023Updated 2 years ago
- Demonstrating the capabilities of DuckDB as a transformation engine for data lakes☆35Oct 8, 2024Updated last year
- Clean Async State Management☆12Jan 30, 2025Updated last year
- ☆21May 13, 2025Updated last year
- ☆10Jun 12, 2026Updated 2 weeks ago
- A quiz for learning Tabular Editor.☆17Mar 7, 2023Updated 3 years ago
- Project utilising data from the Age of Empires api at 'https://aoestats.io'☆53Dec 8, 2024Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Prototyping GeoZarr demonstrations☆24Updated this week
- ☆15Feb 23, 2026Updated 4 months ago
- ☆18Dec 3, 2025Updated 6 months ago
- Terminal-based context management for AI driven development☆22Oct 3, 2025Updated 9 months ago
- A self-contained, ready to run Airflow and Kafka project. Can be run locally or within codespaces.☆16Jul 15, 2023Updated 2 years ago
- ☆27Nov 26, 2025Updated 7 months ago
- Repo manifest for TheParasiteProject☆18Dec 29, 2025Updated 6 months ago
- Cache the intermediate results of queries on timeseries data in DataFusion.☆19Oct 29, 2024Updated last year
- ☆15Jun 1, 2026Updated last month
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Langchain Agents☆29Aug 7, 2024Updated last year
- Time series anomaly detection for Rust☆20Apr 7, 2026Updated 2 months ago
- ☆30Feb 11, 2024Updated 2 years ago
- Config files for my GitHub profile.☆22Mar 7, 2025Updated last year
- Data pipeline from device to cloud☆11May 14, 2022Updated 4 years ago
- Complete sample application for Spin Developers☆16Apr 27, 2023Updated 3 years ago
- Strongly-typed Rust code generation for AWS Lambda from OpenAPI definitions☆16Feb 17, 2026Updated 4 months ago
- This is a modern RESTful API built with Node.js and Express, designed to interact with a PostgreSQL database.☆18Jan 29, 2026Updated 5 months ago
- A super simple cloudflare worker that returns the location of the user based on the IP address.☆18Sep 29, 2025Updated 9 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Vue bindings for LiveStore☆32Jan 4, 2026Updated 5 months ago
- An API for saving Tomatos and stuff, used in the article "An In Depth Guide Into a Ridiculously Simple API Using .NET Core"☆12Mar 11, 2017Updated 9 years ago
- ☆27May 29, 2024Updated 2 years ago
- A tool designed to detect the vulnerability **CVE-2025-31650** in Apache Tomcat (versions 10.1.10 to 10.1.39)☆20Apr 30, 2025Updated last year
- 踊るうんこのgif画像を生成します。☆17May 7, 2022Updated 4 years ago
- Preview Repo for the upcoming Rust-Axum-Base (a code base for production Rust Axum web app / service)☆13Oct 18, 2023Updated 2 years ago
- ☆17Nov 27, 2025Updated 7 months ago