An AWS Data Engineering End-to-End Project (Glue, Lambda, Kinesis, Redshift, QuickSight, Athena, EC2, S3)
☆17Sep 20, 2023Updated 2 years ago
Alternatives and similar repositories for aws_end_to_end_streaming_pipeline
Users that are interested in aws_end_to_end_streaming_pipeline are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Glue ETL job or EMR Spark that gets from data catalog, modifies and uploads to S3 and Data Catalog☆13Aug 26, 2023Updated 2 years ago
- Repository for the Demo of using DVC with PyCaret & MLOps (DVC Office Hours - 20th Jan, 2022)☆11Jan 20, 2022Updated 4 years ago
- ☆13Oct 28, 2025Updated 9 months ago
- Writes the CSV file to Postgres, read table and modify it. Write more tables to Postgres with Airflow.☆38Sep 1, 2023Updated 2 years ago
- Fine tuned LLM examples running on Kubernetes☆11Oct 1, 2023Updated 2 years ago
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- GitHub Action That Submits Argo Workflows For Execution on Your GKE Cluster☆16Jan 25, 2021Updated 5 years ago
- Example of how to build machine learning training workflow on AWS by Prefect☆12Nov 2, 2022Updated 3 years ago
- This solution helps you deploy ETL processes and data storage resources to create an Insurance Lake using Amazon S3 buckets for storage, …☆19Feb 5, 2026Updated 5 months ago
- Docker Apache Airflow☆13Mar 1, 2023Updated 3 years ago
- MLOps Implementing "Brain Computer Interface" on Kubernetes☆16Sep 30, 2022Updated 3 years ago
- ☆22Oct 21, 2024Updated last year
- In this project, we will be deploying a Kubernetes cluster using a Jenkins CI/CD pipeline. We will be utilizing various DevOps tools such…☆13Jun 6, 2023Updated 3 years ago
- ☆13Jan 7, 2022Updated 4 years ago
- ☆13Apr 24, 2026Updated 3 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Created a Flask API🚀 which can detect toxicity in comment(text)💭 using NLP-BERT🤖. Following MLOps lifecycle🔁 to deploy ML system in p…☆14Jan 23, 2023Updated 3 years ago
- ☆15Dec 1, 2023Updated 2 years ago
- Voice AI assistant with Groq, FastWhisper and llama3 🦙☆18Oct 17, 2024Updated last year
- ☆12Dec 29, 2022Updated 3 years ago
- Use a AWS Glue Python Shell Job to connect to your Amazon Redshift cluster and execute a SQL script stored in Amazon S3.☆21Aug 8, 2022Updated 3 years ago
- Code for the paper "FinRLlama: A Solution to LLM-Engineered Signals Challenge at FinRL Contest 2024"☆12Feb 14, 2025Updated last year
- python toolkit for calibration of near infrared ( NIR) spectra☆20Dec 27, 2024Updated last year
- 📡 Real-time data pipeline with Kafka, Flink, Iceberg, Trino, MinIO, and Superset. Ideal for learning data systems.☆78Jan 18, 2025Updated last year
- This repository contains examples for my article published on Medium☆11Oct 29, 2017Updated 8 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- This project demonstrates how to build and automate an ETL pipeline written in Python and schedule it using open source Apache Airflow or…☆24Aug 21, 2025Updated 11 months ago
- Flink Example☆17Nov 19, 2023Updated 2 years ago
- Plant disease detection app with over 4000 downloads that utilizes ResNet-50 CNN architecture for image classification.☆15Dec 26, 2021Updated 4 years ago
- Analytical solution to the Time-Dependent Schrodinger equation for a particle in an infinite square well☆14Mar 25, 2019Updated 7 years ago
- ☆14Jan 22, 2025Updated last year
- ☆17Dec 11, 2023Updated 2 years ago
- A Deep Reinforcement Learning Library for Automated Trading in Quantitative Finance. NeurIPS 2020. Please star. 🔥☆12Mar 13, 2023Updated 3 years ago
- Jupyterhub like web page for code-server.☆25May 27, 2026Updated 2 months ago
- Demos of tools used in AI engineering☆29Apr 21, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆10Mar 22, 2021Updated 5 years ago
- code snippet for analytics sessions☆34May 17, 2022Updated 4 years ago
- End-to-End ELT data pipeline with Postgres, Airbyte, dbt, Dagster, Snowflake and Metabase☆11Jul 13, 2023Updated 3 years ago
- Learn how multimodal AI merges text, image, and audio for smarter models☆31Jan 21, 2025Updated last year
- Uses Milvus and OpenAI's API to perform question answering over documents with a chat interface☆20Aug 14, 2023Updated 2 years ago
- Two algorithms based on linear programming to discover classification rules for interpretable learning.☆23Jun 13, 2025Updated last year
- This solution helps you deploy ETL processes and data storage resources to create an Insurance Lake using Amazon S3 buckets for storage, …☆37Mar 12, 2026Updated 4 months ago