Get Crypto data from API, stream it to Kafka with Airflow. Write data to MySQL and visualize with Metabase
☆17Oct 2, 2023Updated 2 years ago
Alternatives and similar repositories for crypto_api_kafka_airflow_streaming
Users that are interested in crypto_api_kafka_airflow_streaming are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Glue ETL job or EMR Spark that gets from data catalog, modifies and uploads to S3 and Data Catalog☆13Aug 26, 2023Updated 3 years ago
- Writes the CSV file to Postgres, read table and modify it. Write more tables to Postgres with Airflow.☆38Sep 1, 2023Updated 3 years ago
- Create a streaming data, transfer it to Kafka, modify it with PySpark, take it to ElasticSearch and MinIO☆66Jul 21, 2023Updated 3 years ago
- Get data from API, run a scheduled script with Airflow, send data to Kafka and consume with Spark, then write to Cassandra☆145Jul 27, 2023Updated 3 years ago
- Data pipeline to build a data warehouse on Postgres☆16Aug 11, 2024Updated 2 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Scan and monitor your network effortlessly! Nmap Prometheus Exporter provides insights into network health and security with Prometheus-c…☆15Oct 2, 2023Updated 2 years ago
- ingest, model, forecast, ! ...but also I'm just learning Luigi☆14Dec 8, 2022Updated 3 years ago
- Scrape Reddit Finance Forums for Social Sentiment Analysis☆13Oct 20, 2021Updated 4 years ago
- ☆20Mar 11, 2025Updated last year
- ☆14May 22, 2023Updated 3 years ago
- Welcome to my data engineering projects repository! Here you will find a collection of data engineering projects that I have worked on.☆25Apr 27, 2023Updated 3 years ago
- Some example projects for Data Engineers to build, end-to-end.☆39Nov 8, 2023Updated 2 years ago
- Telegram Bot SDK example with a Docker and Ngrok setup☆19Jul 28, 2024Updated 2 years ago
- Particle swarm optimization (PSO) in algorithmic trading example using Backtrader backtesting framework.☆19Mar 19, 2020Updated 6 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ChatOps for Tinkerbell☆15Jun 11, 2020Updated 6 years ago
- Проект по обучению ручной и автоматической торговли криптовалютами.☆26Jun 8, 2018Updated 8 years ago
- Cli Prometheus metrics viewer.☆13May 3, 2023Updated 3 years ago
- Prometheus exporter for Amazon Smart Air Quality Monitor☆12Jan 21, 2022Updated 4 years ago
- Python Pydantic model of the Prometheus Alertmanager alert payload☆10Jul 24, 2023Updated 3 years ago
- Streamlit Dashboard over Superstore Data stored in Postgres Docker container. With SQLAlchemy + Plotly Express☆12Oct 16, 2024Updated last year
- A simple javascript library for reading glucose data from the Dexcom Share API.☆11Apr 10, 2026Updated 5 months ago
- Telegram bot that manages creation of queues / attendance lists for periodic events.☆15Dec 23, 2024Updated last year
- this is a simple sso for devops api☆12May 31, 2014Updated 12 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Documentation to host multiple websites, or subdomain on a VPS☆20Dec 15, 2020Updated 5 years ago
- CLI to start Flask projects☆12Aug 24, 2024Updated 2 years ago
- Tiny IP Address Registry API Server (IPAM)☆11May 1, 2023Updated 3 years ago
- terrajux diffs the source code of a terraform project and all of its transitive module dependencies between two git refs.☆11Jun 14, 2021Updated 5 years ago
- Browser extension to return Link Previews to X/Twitter☆13Oct 8, 2023Updated 2 years ago
- Fritz!Box tool set, e.g. parsing the call monitor, adding phone entries to phonebook, auto-blocking calls etc.☆11Feb 19, 2023Updated 3 years ago
- Personal website built with Astro and Tailwind. Deployed on Vercel.☆13Jan 22, 2026Updated 8 months ago
- one stack for all needs☆18Aug 12, 2026Updated last month
- Simple http server that exposes a AWS Python Lambda☆14Sep 17, 2019Updated 7 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Tmux plugin to display glucose data from xDrip as a status icon.☆13Oct 9, 2024Updated last year
- End to end data engineering project☆59Oct 27, 2022Updated 3 years ago
- A repository with Docker using lando for and bedrock and sage for wordpress☆14Dec 3, 2022Updated 3 years ago
- Program summarizes news articles into a couple of sentences. This project was inspired by SMMRY, the algorithm used in many subreddits to…☆10Jan 15, 2019Updated 7 years ago
- My Insight Data Engineering Fellowship project. I implemented a big data processing pipeline based on lambda architecture, that aggrega…☆507Aug 24, 2022Updated 4 years ago
- A hello world app made in FastAPI and HTMX☆11Aug 26, 2023Updated 3 years ago
- A small collection of FFMPEG tools which I use while working on Gooey☆15May 28, 2025Updated last year