Get Crypto data from API, stream it to Kafka with Airflow. Write data to MySQL and visualize with Metabase
☆17Oct 2, 2023Updated 2 years ago
Alternatives and similar repositories for crypto_api_kafka_airflow_streaming
Users that are interested in crypto_api_kafka_airflow_streaming are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Create a streaming data, transfer it to Kafka, modify it with PySpark, take it to ElasticSearch and MinIO☆65Jul 21, 2023Updated 2 years ago
- Get data from API, run a scheduled script with Airflow, send data to Kafka and consume with Spark, then write to Cassandra☆146Jul 27, 2023Updated 2 years ago
- A project portfolio to accompany my resume☆30Sep 5, 2023Updated 2 years ago
- An AWS Data Engineering End-to-End Project (Glue, Lambda, Kinesis, Redshift, QuickSight, Athena, EC2, S3)☆16Sep 20, 2023Updated 2 years ago
- ☆13Mar 5, 2023Updated 3 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- This repository is the implementation of the paper "Beating Atari with Natural Language Guided Reinforcement Learning"☆11Nov 25, 2018Updated 7 years ago
- RedditR for Content Engagement and Recommendation☆18Dec 21, 2017Updated 8 years ago
- Welcome to my data engineering projects repository! Here you will find a collection of data engineering projects that I have worked on.☆24Apr 27, 2023Updated 2 years ago
- An intelligent note taking app built with Clerk, Next.js, OpenAI, Pinecone, Prisma, Shadcn UI and more.☆19Jan 14, 2024Updated 2 years ago
- ☆21Mar 11, 2025Updated last year
- how to unit test your PySpark code☆29Mar 26, 2021Updated 5 years ago
- This research goal is to build binary classifier model which are able to separate fraud transactions from non-fraud transactions.☆24Nov 14, 2023Updated 2 years ago
- Reinforcement Learning Project☆20May 3, 2023Updated 2 years ago
- A simple deployment of Python application on GCP.☆18May 29, 2023Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Arduino Internet Watchdog Device. It will check for Internet connectivity and if it is lost, it will restart your router and/or modem. In…☆20Nov 6, 2025Updated 5 months ago
- Study and research with your docs, media, and AI in one place☆40Apr 12, 2026Updated last week
- A user-friendly Command & Control (C&C) web platform for remote monitoring, management, and task automation across multiple devices.☆14Dec 15, 2024Updated last year
- ChatOps for Tinkerbell☆15Jun 11, 2020Updated 5 years ago
- Sample ELT project using Dagster, data load tool and Snowflake☆41Jul 20, 2024Updated last year
- Cli Prometheus metrics viewer.☆14May 3, 2023Updated 2 years ago
- Inventory is an application that tracks deployed services/containers. It was built with a homelab in mind.☆16Jun 9, 2025Updated 10 months ago
- Prometheus exporter for Amazon Smart Air Quality Monitor☆12Jan 21, 2022Updated 4 years ago
- Python Pydantic model of the Prometheus Alertmanager alert payload☆10Jul 24, 2023Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ryantoken.com v3 - written in Svelte, Tailwind, and mdsvex. Replaced by ryantoken.com v4☆12Jul 27, 2025Updated 8 months ago
- Penpot Copilot is your AI-powered design assistant, revolutionizing the way you create.☆15Dec 16, 2024Updated last year
- Fast Python motion planning algorithm implementations with demos in pybullet☆34Jan 2, 2025Updated last year
- Produce Kafka messages, consume them and upload into Cassandra, MongoDB.☆43Sep 26, 2023Updated 2 years ago
- Tools for diffing and comparing web content. Also includes a web server that makes diffs available as an HTTP service.☆20Apr 6, 2026Updated last week
- ☆39Jan 26, 2025Updated last year
- End-to-end data platform leveraging the Modern data stack☆52Apr 10, 2024Updated 2 years ago
- this is a simple sso for devops api☆12May 31, 2014Updated 11 years ago
- This web extension allows users to navigate Glassdoor while logged out.☆14Jan 15, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- CLI to start Flask projects☆12Aug 24, 2024Updated last year
- Playable synthesizer created with Tone.js, Next.js, and React.☆10Aug 14, 2022Updated 3 years ago
- A template for Python projects that need to use a relational database, including tooling for managing schema migrations and testing again…☆13Dec 13, 2024Updated last year
- AI-based project for predicting fashion trends using image processing, sentiment analysis, and clustering on Instagram data.☆27Jun 16, 2023Updated 2 years ago
- GraphQL API for cloud pricing. Contains over 3M public prices from AWS, Azure and GCP. Self-updates prices via an automated weekly job.☆20Mar 9, 2026Updated last month
- terrajux diffs the source code of a terraform project and all of its transitive module dependencies between two git refs.☆11Jun 14, 2021Updated 4 years ago
- one stack for all needs☆18Mar 15, 2026Updated last month