The Data Pipeline and Analytics Stack is a comprehensive solution designed for processing, storing, and visualizing data. Explore a complete data pipeline with all components seamlessly set up and ready to use
☆18Dec 26, 2023Updated 2 years ago
Alternatives and similar repositories for bigdata-ETL-pipeline
Users that are interested in bigdata-ETL-pipeline are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Conduktor Helm Chart Repository☆11Oct 19, 2026Updated last week
- Run an open-source data LakeHouse locally using Docker Compose☆12May 31, 2024Updated 2 years ago
- In this project I have built etl pipline which scraps the trending repository based on month,week and day LIVE extract other related info…☆12Sep 9, 2023Updated 3 years ago
- A data pipeline for the ingestion & visualisation of U.S Geological Survey Earthquake data☆14Jun 24, 2024Updated 2 years ago
- Hands-on workshop with Apache Iceberg☆15Mar 13, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A Firebase Cloud Function and a Firebase hosted web app to treat weather data collected by Cloud IoT Core☆18Mar 10, 2019Updated 7 years ago
- Gradient Boosting Models on Real-Time Sensor Data for AI-Enhanced Vehicle Predictive Maintenance. By using a web-based interface to forec…☆19Oct 20, 2026Updated last week
- ☆10Aug 17, 2021Updated 5 years ago
- trino monitoring with JMX metrics through Prometheus and Grafana☆18Aug 14, 2024Updated 2 years ago
- AI-powered desktop app for large-scale transcription of audio, images, and PDFs into high-quality text, with built-in quality checks and …☆14Jul 29, 2026Updated 3 months ago
- Predictive Incident Management analyses large data sets to identify risk patterns, predict outcomes, and guide teams on effective decisio…☆16Nov 25, 2022Updated 3 years ago
- FleetTrack is a data collection, ingestion and visualisation application which operates on pings from vehicles in a fleet.☆23Jun 26, 2024Updated 2 years ago
- Automate data collection from Spotify's worldwide ranking in 50+ countries☆25May 3, 2020Updated 6 years ago
- Patterns and concepts for building resilient data pipelines in Python and Scala☆17Aug 27, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Spark-based pipeline to extract and parse monthly games from the Lichess database.☆22Sep 22, 2025Updated last year
- Template for projects in PyTorch powered with PyTorch Lightning, Telegrad and MLflow. Get updates on mobile and streamline PyTorch code f…☆10May 1, 2023Updated 3 years ago
- Jupyter notebooks for the teaching of mechanics☆11Oct 8, 2024Updated 2 years ago
- Solr benchmarking and load testing harness☆16Jan 7, 2025Updated last year
- Sample code and documentation for very basic things that I can't remember but want to aggregate in one place☆13Nov 7, 2021Updated 4 years ago
- ☆14Mar 24, 2021Updated 5 years ago
- Training intrinsically motivated, independent Q-learners to play Tic-Tac-Toe☆11May 12, 2021Updated 5 years ago
- Extension giúp ta tự động điền form Quy chế + Pháp Luật - HUST☆26Aug 11, 2026Updated 2 months ago
- Some exercises to learn Spark. Solved in Python.☆21Oct 15, 2024Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆16Dec 13, 2023Updated 2 years ago
- Completion of three Deep Q-Networks : Deep Q-Network (DQN), Double Deep Q-Network (DDQN), Double Dueling Deep Q-Network (D3QN)☆12Jun 26, 2021Updated 5 years ago
- Spark and Hive docker containers sharing a common MySQL metastore☆26Apr 17, 2020Updated 6 years ago
- Skribify is a powerful transcription and summarization tool that leverages the power of OpenAI's GPT-4 and WhisperAI to generate concise …☆12Oct 21, 2026Updated last week
- A Retail store management system - DBMS project (Sep 2015) written in Django (Python)☆11Aug 11, 2020Updated 6 years ago
- Hands on workshop "Refactor your Jupyter notebooks into maintainable data science code with Kedro"☆18Jan 22, 2025Updated last year
- Airflow POC demo : 1) env set up 2) airflow DAG 3) Spark/ML pipeline | #DE☆11Dec 19, 2022Updated 3 years ago
- 参考 Chat2DB 的效果，使用 chatgpt 进行自然语言翻译，然后对数据库进行操作，使用 rust 语言实现的 web 应用。☆10Jan 13, 2025Updated last year
- Cloud based Data Platform based on Apache Spark☆28Jun 30, 2026Updated 3 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Doing sql in notebooks.☆15Aug 14, 2023Updated 3 years ago
- Stand-a-lone version of bac4 without the Obsidian dependency☆17Dec 12, 2025Updated 10 months ago
- ☆14Jan 14, 2017Updated 9 years ago
- Backtest portfolio allocation strategies.☆13May 20, 2021Updated 5 years ago
- Wildfire Modeling in Yosemite National Park☆19Apr 14, 2025Updated last year
- ☆13Jun 21, 2021Updated 5 years ago
- This is my Apache Airflow Local development setup on Windows 10 WSL2/Mac using docker-compose. It will also include some sample DAGs and …☆34Feb 9, 2024Updated 2 years ago