bkatwal / distributed-kafka-consumer-pythonLinks
A distributed Kafka Consumer in Python using Ray
☆23Updated 2 years ago
Alternatives and similar repositories for distributed-kafka-consumer-python
Users that are interested in distributed-kafka-consumer-python are comparing it to the libraries listed below
Sorting:
- Sync DAG changes from Git to Airflow☆70Updated 4 months ago
- Simple and flexible ML workflow engine☆420Updated 2 years ago
- Boilerplate for PySpark on Cloud Kubernetes☆33Updated 4 years ago
- Python driver/sqlalchemy/superset connectors☆449Updated this week
- A repository that makes it easy to get up and running with Prefect 2 using Docker Compose.☆140Updated 8 months ago
- Python client for Trino☆407Updated 3 months ago
- A simple guide to understand Prefect and make it work with your own docker-compose configuration.☆161Updated last year
- The Prefect API and backend☆248Updated 2 years ago
- The Python fake data producer for Apache Kafka® is a complete demo app allowing you to quickly produce JSON fake streaming datasets and …☆85Updated last year
- A plugin for Apache Airflow that allows you to edit DAGs in browser☆455Updated last month
- Code examples showing flow deployment to various types of infrastructure☆111Updated 2 years ago
- This library can convert a pydantic class to a avro schema or generate python code from a avro schema.☆82Updated 2 months ago
- Grafana dashboards and StatsD exporter config for Airflow monitoring☆289Updated last year
- Helm charts for deploying Prefect Services☆137Updated this week
- Barebones Python FastAPI in Kubernetes☆135Updated 4 years ago
- Fast iterative local development and testing of Apache Airflow workflows☆202Updated 4 months ago
- Project demonstrating how to automate Prefect 2.0 deployments to AWS ECS Fargate☆116Updated 2 years ago
- A workshop with several modules to help learn Feast, an open-source feature store☆96Updated last month
- Build Data Lake using Open Source tools☆117Updated 6 months ago
- Apache Airflow - OpenApi Client for Python☆440Updated last week
- ☆43Updated 3 years ago
- Great Expectations Airflow operator☆169Updated 2 weeks ago
- Python Streaming DataFrames for Kafka☆1,501Updated last month
- Ray provider for Apache Airflow☆47Updated last year
- Template Dagster repo using poetry and a single Docker container; works well with CICD☆67Updated 3 years ago
- MLflow deployment with 1 command☆214Updated last week
- A Python package to submit and manage Apache Spark applications on Kubernetes.☆46Updated 4 months ago
- A CLI tool to streamline getting started with Apache Airflow™ and managing multiple Airflow projects☆225Updated 7 months ago
- Snippets and templates representing common Customer Success patterns☆258Updated 11 months ago
- A demo of Prometheus+Grafana for monitoring an ML model served with FastAPI.☆233Updated last year