Get Crypto data from API, stream it to Kafka with Airflow. Write data to MySQL and visualize with Metabase
☆17Oct 2, 2023Updated 2 years ago
Alternatives and similar repositories for crypto_api_kafka_airflow_streaming
Users that are interested in crypto_api_kafka_airflow_streaming are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Glue ETL job or EMR Spark that gets from data catalog, modifies and uploads to S3 and Data Catalog☆13Aug 26, 2023Updated 2 years ago
- Docker Apache Airflow☆13Mar 1, 2023Updated 3 years ago
- Writes the CSV file to Postgres, read table and modify it. Write more tables to Postgres with Airflow.☆37Sep 1, 2023Updated 2 years ago
- Create a streaming data, transfer it to Kafka, modify it with PySpark, take it to ElasticSearch and MinIO☆65Jul 21, 2023Updated 2 years ago
- Get data from API, run a scheduled script with Airflow, send data to Kafka and consume with Spark, then write to Cassandra☆146Jul 27, 2023Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Data pipeline to build a data warehouse on Postgres☆15Aug 11, 2024Updated last year
- A project portfolio to accompany my resume☆30Sep 5, 2023Updated 2 years ago
- An AWS Data Engineering End-to-End Project (Glue, Lambda, Kinesis, Redshift, QuickSight, Athena, EC2, S3)☆16Sep 20, 2023Updated 2 years ago
- Scan and monitor your network effortlessly! Nmap Prometheus Exporter provides insights into network health and security with Prometheus-c…☆15Oct 2, 2023Updated 2 years ago
- RedditR for Content Engagement and Recommendation☆18Dec 21, 2017Updated 8 years ago
- Welcome to my data engineering projects repository! Here you will find a collection of data engineering projects that I have worked on.☆25Apr 27, 2023Updated 3 years ago
- Scrape Reddit Finance Forums for Social Sentiment Analysis☆13Oct 20, 2021Updated 4 years ago
- An intelligent note taking app built with Clerk, Next.js, OpenAI, Pinecone, Prisma, Shadcn UI and more.☆20Jan 14, 2024Updated 2 years ago
- ☆21Mar 11, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Databricks ML in Action, Published by Packt☆33Mar 2, 2026Updated 3 months ago
- Arduino Internet Watchdog Device. It will check for Internet connectivity and if it is lost, it will restart your router and/or modem. In…☆21Nov 6, 2025Updated 7 months ago
- Particle swarm optimization (PSO) in algorithmic trading example using Backtrader backtesting framework.☆19Mar 19, 2020Updated 6 years ago
- Some example projects for Data Engineers to build, end-to-end.☆39Nov 8, 2023Updated 2 years ago
- A user-friendly Command & Control (C&C) web platform for remote monitoring, management, and task automation across multiple devices.☆14Dec 15, 2024Updated last year
- ChatOps for Tinkerbell☆15Jun 11, 2020Updated 6 years ago
- 📕Ansible playbooks for Raspberry Pi, Linux and Mac☆14Dec 22, 2024Updated last year
- ☆14Feb 17, 2025Updated last year
- Notes on many interesting RL papers☆26Sep 30, 2019Updated 6 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Cli Prometheus metrics viewer.☆14May 3, 2023Updated 3 years ago
- Inventory is an application that tracks deployed services/containers. It was built with a homelab in mind.☆16Jun 9, 2025Updated last year
- A minimal implementation of a Litestar application☆16Jan 18, 2024Updated 2 years ago
- Prometheus exporter for Amazon Smart Air Quality Monitor☆12Jan 21, 2022Updated 4 years ago
- NIST Cybersecurity Framework (CSF) Profile Assessment Tool - Track controls, assign ownership, document findings, score security states, …☆39Updated this week
- Python Pydantic model of the Prometheus Alertmanager alert payload☆10Jul 24, 2023Updated 2 years ago
- ryantoken.com v3 - written in Svelte, Tailwind, and mdsvex. Replaced by ryantoken.com v4☆12Jul 27, 2025Updated 10 months ago
- End-to-end data platform leveraging the Modern data stack☆52Apr 10, 2024Updated 2 years ago
- this is a simple sso for devops api☆12May 31, 2014Updated 12 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Study and research with your docs, media, and AI in one place☆45May 17, 2026Updated last month
- CLI to start Flask projects☆12Aug 24, 2024Updated last year
- Playable synthesizer created with Tone.js, Next.js, and React.☆10Aug 14, 2022Updated 3 years ago
- A template for Python projects that need to use a relational database, including tooling for managing schema migrations and testing again…☆13Dec 13, 2024Updated last year
- 🥢 The simplest way to create REST API with Node.js, Express.js, and TypeORM.☆11Oct 30, 2025Updated 7 months ago
- GraphQL API for cloud pricing. Contains over 3M public prices from AWS, Azure and GCP. Self-updates prices via an automated weekly job.☆22Jun 10, 2026Updated last week
- Tiny IP Address Registry API Server (IPAM)☆11May 1, 2023Updated 3 years ago