Get Crypto data from API, stream it to Kafka with Airflow. Write data to MySQL and visualize with Metabase
☆17Oct 2, 2023Updated 2 years ago
Alternatives and similar repositories for crypto_api_kafka_airflow_streaming
Users that are interested in crypto_api_kafka_airflow_streaming are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Docker Apache Airflow☆13Mar 1, 2023Updated 3 years ago
- Glue ETL job or EMR Spark that gets from data catalog, modifies and uploads to S3 and Data Catalog☆13Aug 26, 2023Updated 2 years ago
- Writes the CSV file to Postgres, read table and modify it. Write more tables to Postgres with Airflow.☆38Sep 1, 2023Updated 2 years ago
- Create a streaming data, transfer it to Kafka, modify it with PySpark, take it to ElasticSearch and MinIO☆66Jul 21, 2023Updated 3 years ago
- Data pipeline to build a data warehouse on Postgres☆15Aug 11, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A project portfolio to accompany my resume☆30Sep 5, 2023Updated 2 years ago
- An AWS Data Engineering End-to-End Project (Glue, Lambda, Kinesis, Redshift, QuickSight, Athena, EC2, S3)☆17Sep 20, 2023Updated 2 years ago
- RedditR for Content Engagement and Recommendation☆18Dec 21, 2017Updated 8 years ago
- ☆20Mar 11, 2025Updated last year
- Databricks ML in Action, Published by Packt☆35Mar 2, 2026Updated 5 months ago
- A user-friendly Command & Control (C&C) web platform for remote monitoring, management, and task automation across multiple devices.☆14Aug 4, 2026Updated last week
- ChatOps for Tinkerbell☆15Jun 11, 2020Updated 6 years ago
- 📕Ansible playbooks for Raspberry Pi, Linux and Mac☆14Dec 22, 2024Updated last year
- ☆14Feb 17, 2025Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Produce Kafka messages, consume them and upload into Cassandra, MongoDB.☆43Sep 26, 2023Updated 2 years ago
- Sample ELT project using Dagster, data load tool and Snowflake☆51Jul 20, 2024Updated 2 years ago
- Prometheus exporter for Amazon Smart Air Quality Monitor☆12Jan 21, 2022Updated 4 years ago
- Inventory is an application that tracks deployed services/containers. It was built with a homelab in mind.☆16Jun 9, 2025Updated last year
- Python Pydantic model of the Prometheus Alertmanager alert payload☆10Jul 24, 2023Updated 3 years ago
- Streamlit Dashboard over Superstore Data stored in Postgres Docker container. With SQLAlchemy + Plotly Express☆12Oct 16, 2024Updated last year
- End-to-end data platform leveraging the Modern data stack☆52Apr 10, 2024Updated 2 years ago
- Telegram bot that manages creation of queues / attendance lists for periodic events.☆15Dec 23, 2024Updated last year
- An experimental TUI framework for Python, inspired by React and Tailwind☆18Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Playable synthesizer created with Tone.js, Next.js, and React.☆10Aug 14, 2022Updated 4 years ago
- this is a simple sso for devops api☆12May 31, 2014Updated 12 years ago
- Documentation to host multiple websites, or subdomain on a VPS☆20Dec 15, 2020Updated 5 years ago
- CLI to start Flask projects☆12Aug 24, 2024Updated last year
- A template for Python projects that need to use a relational database, including tooling for managing schema migrations and testing again…☆13Dec 13, 2024Updated last year
- 🥢 The simplest way to create REST API with Node.js, Express.js, and TypeORM.☆11Oct 30, 2025Updated 9 months ago
- terrajux diffs the source code of a terraform project and all of its transitive module dependencies between two git refs.☆11Jun 14, 2021Updated 5 years ago
- one stack for all needs☆18Updated this week
- Simple http server that exposes a AWS Python Lambda☆14Sep 17, 2019Updated 6 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Tmux plugin to display glucose data from xDrip as a status icon.☆13Oct 9, 2024Updated last year
- Latte is a modern data engineering toolkit.☆14Mar 4, 2024Updated 2 years ago
- Systems Administration tools that I have used in the past to make my life easier☆11Mar 30, 2018Updated 8 years ago
- End to end data engineering project☆59Oct 27, 2022Updated 3 years ago
- A repository with Docker using lando for and bedrock and sage for wordpress☆14Dec 3, 2022Updated 3 years ago
- My Insight Data Engineering Fellowship project. I implemented a big data processing pipeline based on lambda architecture, that aggrega…☆508Aug 24, 2022Updated 3 years ago
- A hello world app made in FastAPI and HTMX☆10Aug 26, 2023Updated 2 years ago