The Data Pipeline and Analytics Stack is a comprehensive solution designed for processing, storing, and visualizing data. Explore a complete data pipeline with all components seamlessly set up and ready to use
☆18Dec 26, 2023Updated 2 years ago
Alternatives and similar repositories for bigdata-ETL-pipeline
Users that are interested in bigdata-ETL-pipeline are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Building Data Lakehouse by open source technology. Support end to end data pipeline, from source data on AWS S3 to Lakehouse, visualize a…☆41Dec 15, 2025Updated 9 months ago
- Run an open-source data LakeHouse locally using Docker Compose☆12May 31, 2024Updated 2 years ago
- This is a recipe for docker container based architecture based on airflow, kafka,spark,docker☆19Oct 15, 2024Updated last year
- In this project I have built etl pipline which scraps the trending repository based on month,week and day LIVE extract other related info…☆12Sep 9, 2023Updated 3 years ago
- A Firebase Cloud Function and a Firebase hosted web app to treat weather data collected by Cloud IoT Core☆18Mar 10, 2019Updated 7 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- trino monitoring with JMX metrics through Prometheus and Grafana☆18Aug 14, 2024Updated 2 years ago
- This project shows how to capture changes from postgres database and stream them into kafka☆43May 17, 2024Updated 2 years ago
- Predictive Incident Management analyses large data sets to identify risk patterns, predict outcomes, and guide teams on effective decisio…☆16Nov 25, 2022Updated 3 years ago
- Jupyter notebooks for the teaching of mechanics☆11Oct 8, 2024Updated 2 years ago
- Sample Data Lakehouse deployed in Docker containers using Apache Iceberg, Minio, Trino and a Hive Metastore. Can be used for local testin…☆81Sep 2, 2023Updated 3 years ago
- Jena Plugins for Pentaho Kettle to transform data into RDF☆12May 31, 2023Updated 3 years ago
- Template for projects in PyTorch powered with PyTorch Lightning, Telegrad and MLflow. Get updates on mobile and streamline PyTorch code f…☆10May 1, 2023Updated 3 years ago
- Sample code and documentation for very basic things that I can't remember but want to aggregate in one place☆13Nov 7, 2021Updated 4 years ago
- ☆23Feb 5, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A simple Perceptron in Python☆10Feb 11, 2022Updated 4 years ago
- Some exercises to learn Spark. Solved in Python.☆21Oct 15, 2024Updated last year
- Extension giúp ta tự động điền form Quy chế + Pháp Luật - HUST☆24Aug 11, 2026Updated last month
- Hands on workshop "Refactor your Jupyter notebooks into maintainable data science code with Kedro"☆18Jan 22, 2025Updated last year
- Spark and Hive docker containers sharing a common MySQL metastore☆26Apr 17, 2020Updated 6 years ago
- ☆14Jan 14, 2017Updated 9 years ago
- Completion of three Deep Q-Networks : Deep Q-Network (DQN), Double Deep Q-Network (DDQN), Double Dueling Deep Q-Network (D3QN)☆12Jun 26, 2021Updated 5 years ago
- Skribify is a powerful transcription and summarization tool that leverages the power of OpenAI's GPT-4 and WhisperAI to generate concise …☆12Aug 6, 2026Updated 2 months ago
- A Retail store management system - DBMS project (Sep 2015) written in Django (Python)☆11Aug 11, 2020Updated 6 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Doing sql in notebooks.☆15Aug 14, 2023Updated 3 years ago
- 参考 Chat2DB 的效果，使用 chatgpt 进行自然语言翻译，然后对数据库进行操作，使用 rust 语言实现的 web 应用。☆10Jan 13, 2025Updated last year
- This is my Apache Airflow Local development setup on Windows 10 WSL2/Mac using docker-compose. It will also include some sample DAGs and …☆34Feb 9, 2024Updated 2 years ago
- Ansible collection to deploy the components of TDP☆23Updated this week
- ⚡ FutureGPT - Application development framework that connects GPT-4 with external data, the internet, other applications and language mod…☆13May 14, 2023Updated 3 years ago
- ☆13Jun 21, 2021Updated 5 years ago
- Source code for Deep Reinforcement Learning for Real-Time Optimization of Pumps in Water Distribution Systems paper.☆26May 25, 2023Updated 3 years ago
- A simple pipeline utilising cron, Postgres, AWS EC2, and Metabase☆13Jul 9, 2024Updated 2 years ago
- Sidewall is a Python library for interacting with the Dimensions search API.☆17Sep 11, 2024Updated 2 years ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- ☆12Mar 17, 2022Updated 4 years ago
- Kafka and Spark Integration. Alll code in maven project.☆14Jun 30, 2026Updated 3 months ago
- MCP Client and Server apps to demo integration of Azure OpenAI-based AI agent with a Data Warehouse, exposed through GraphQL in Microsoft…☆11Jul 6, 2025Updated last year
- Web app designed to enhance your interaction with OpenAI's language models☆12Jun 14, 2023Updated 3 years ago
- Create a QnA bot on a pdf☆16May 27, 2023Updated 3 years ago
- This repository serves as a comprehensive guide to effective data modeling and robust data quality assurance using popular open-source to…☆44Sep 20, 2023Updated 3 years ago
- Hyperaudio Converter - converts from JSON/SRT to HTML Based Interactive Transcript☆14Dec 16, 2020Updated 5 years ago