Get Crypto data from API, stream it to Kafka with Airflow. Write data to MySQL and visualize with Metabase
☆17Oct 2, 2023Updated 2 years ago
Alternatives and similar repositories for crypto_api_kafka_airflow_streaming
Users that are interested in crypto_api_kafka_airflow_streaming are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Glue ETL job or EMR Spark that gets from data catalog, modifies and uploads to S3 and Data Catalog☆13Aug 26, 2023Updated 2 years ago
- Writes the CSV file to Postgres, read table and modify it. Write more tables to Postgres with Airflow.☆37Sep 1, 2023Updated 2 years ago
- Get data from API, run a scheduled script with Airflow, send data to Kafka and consume with Spark, then write to Cassandra☆146Jul 27, 2023Updated 2 years ago
- Data pipeline to build a data warehouse on Postgres☆15Aug 11, 2024Updated last year
- A Serverless Web Crawler built on AWS☆15Jan 9, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A project portfolio to accompany my resume☆30Sep 5, 2023Updated 2 years ago
- An AWS Data Engineering End-to-End Project (Glue, Lambda, Kinesis, Redshift, QuickSight, Athena, EC2, S3)☆16Sep 20, 2023Updated 2 years ago
- Scan and monitor your network effortlessly! Nmap Prometheus Exporter provides insights into network health and security with Prometheus-c…☆15Oct 2, 2023Updated 2 years ago
- RedditR for Content Engagement and Recommendation☆18Dec 21, 2017Updated 8 years ago
- Welcome to my data engineering projects repository! Here you will find a collection of data engineering projects that I have worked on.☆24Apr 27, 2023Updated 3 years ago
- An intelligent note taking app built with Clerk, Next.js, OpenAI, Pinecone, Prisma, Shadcn UI and more.☆19Jan 14, 2024Updated 2 years ago
- how to unit test your PySpark code☆29Mar 26, 2021Updated 5 years ago
- This research goal is to build binary classifier model which are able to separate fraud transactions from non-fraud transactions.☆24Nov 14, 2023Updated 2 years ago
- ☆28Oct 14, 2024Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Arduino Internet Watchdog Device. It will check for Internet connectivity and if it is lost, it will restart your router and/or modem. In…☆20Nov 6, 2025Updated 6 months ago
- Documentation to host multiple websites, or subdomain on a VPS☆20Dec 15, 2020Updated 5 years ago
- Some example projects for Data Engineers to build, end-to-end.☆39Nov 8, 2023Updated 2 years ago
- A user-friendly Command & Control (C&C) web platform for remote monitoring, management, and task automation across multiple devices.☆14Dec 15, 2024Updated last year
- ChatOps for Tinkerbell☆15Jun 11, 2020Updated 5 years ago
- 📕Ansible playbooks for Raspberry Pi, Linux and Mac☆14Dec 22, 2024Updated last year
- ☆14Feb 17, 2025Updated last year
- Inventory is an application that tracks deployed services/containers. It was built with a homelab in mind.☆16Jun 9, 2025Updated 11 months ago
- A minimal implementation of a Litestar application☆16Jan 18, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Prometheus exporter for Amazon Smart Air Quality Monitor☆12Jan 21, 2022Updated 4 years ago
- Python Pydantic model of the Prometheus Alertmanager alert payload☆10Jul 24, 2023Updated 2 years ago
- NIST Cybersecurity Framework (CSF) Profile Assessment Tool - Track controls, assign ownership, document findings, score security states, …☆34Updated this week
- ryantoken.com v3 - written in Svelte, Tailwind, and mdsvex. Replaced by ryantoken.com v4☆12Jul 27, 2025Updated 9 months ago
- Produce Kafka messages, consume them and upload into Cassandra, MongoDB.☆43Sep 26, 2023Updated 2 years ago
- An experimental TUI framework for Python, inspired by React and Tailwind☆18Apr 27, 2026Updated last week
- End-to-end data platform leveraging the Modern data stack☆52Apr 10, 2024Updated 2 years ago
- this is a simple sso for devops api☆12May 31, 2014Updated 11 years ago
- This web extension allows users to navigate Glassdoor while logged out.☆14Jan 15, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Study and research with your docs, media, and AI in one place☆43May 2, 2026Updated last week
- CLI to start Flask projects☆12Aug 24, 2024Updated last year
- Playable synthesizer created with Tone.js, Next.js, and React.☆10Aug 14, 2022Updated 3 years ago
- A template for Python projects that need to use a relational database, including tooling for managing schema migrations and testing again…☆13Dec 13, 2024Updated last year
- 🥢 The simplest way to create REST API with Node.js, Express.js, and TypeORM.☆11Oct 30, 2025Updated 6 months ago
- GraphQL API for cloud pricing. Contains over 3M public prices from AWS, Azure and GCP. Self-updates prices via an automated weekly job.☆20Apr 21, 2026Updated 2 weeks ago
- Tiny IP Address Registry API Server (IPAM)☆11May 1, 2023Updated 3 years ago