lsst-sqre / kafka-aggregator
A Kafka aggregator based on the Faust Python Stream Processing library
☆10Updated last year
Alternatives and similar repositories for kafka-aggregator:
Users that are interested in kafka-aggregator are comparing it to the libraries listed below
- A Cookiecutter template for creating Faust projects quickly.☆70Updated 2 years ago
- Faust dockerized application☆68Updated 2 years ago
- Python Rest Client to interact against Schema Registry confluent server☆173Updated this week
- This library can convert a pydantic class to a avro schema or generate python code from a avro schema.☆71Updated this week
- Python AsyncIO Services☆46Updated 11 months ago
- SQLAlchemy dialect for Turbodbc☆23Updated this week
- Event-driven data pipelines☆139Updated last year
- Built a stream processing data pipeline to get data from disparate systems into a dashboard using Kafka as an intermediary.☆29Updated last year
- Lossless in-memory compression of pandas DataFrames and Series powered by the visions type system. Up to 10x less RAM needed for the same…☆28Updated 2 years ago
- Repository to maintain infrastructure to automate Data Workflows☆34Updated 3 years ago
- Generate Apache Avro schemas for Python types including standard library data-classes and Pydantic data models.☆41Updated 7 months ago
- simple, flexible, offline capable, cloud storage with a Python path-like interface☆173Updated 9 months ago
- An opinionated implementation of exclusively using airflow DockerOperators for all Operators☆18Updated 3 years ago
- Derivatives models written with the Tributary data flow library☆23Updated 4 months ago
- Generate avro schemas from python dataclasses, Pydantic models and Faust Records. Code generation from avro schemas. Serialize/Deserializ…☆229Updated last week
- Sample Faust project to process tweets in real-time☆13Updated 4 years ago
- ☆42Updated 9 months ago
- A simple Declarative ORM for Redis using pydantic Models☆42Updated 8 months ago
- RedisTimeSeries python client☆99Updated 2 years ago
- Cross Thread Message Pipe☆18Updated 5 years ago
- Prometheus Exporter for Airflow☆160Updated 9 months ago
- ByteHub: making feature stores simple☆60Updated 3 years ago
- Distributed process pool for Python☆110Updated 2 years ago
- Examples of various flow deployments for Prefect 1.0 (storage and run configurations)☆35Updated 2 years ago
- Distributed event processing for Python based on Redis Streams☆132Updated 4 years ago
- A collection of python utility functions☆11Updated 9 months ago
- Easily LISTEN to PostgreSQL NOTIFY messages☆67Updated 4 years ago
- A template for an AWS Lambda function that triggers Prefect Flow Runs☆20Updated 3 years ago
- A high-performance Python Kafka client. Efficiently from Kafka to Pandas and back.☆40Updated 6 years ago
- Example of High-Speed Subscriber Patterns in ZeroMQ☆11Updated 2 years ago