anemos-io / protobeam
☆22Updated 5 years ago
Alternatives and similar repositories for protobeam:
Users that are interested in protobeam are comparing it to the libraries listed below
- Bullet is a streaming query engine that can be plugged into any singular data stream using a Stream Processing framework like Apache Stor…☆41Updated 2 years ago
- Apache Beam Site☆29Updated 2 weeks ago
- A protobuf schema registry on steroids. It will keep track of the contracts throughout your organization, making sure no contract is brok…☆43Updated 5 years ago
- Kubernetes Operator for the Ververica Platform☆35Updated 2 years ago
- Use SQL to transform your avro schema/records☆28Updated 7 years ago
- Bulletproof Apache Spark jobs with fast root cause analysis of failures.☆72Updated 4 years ago
- Demonstration of a Hive Input Format for Iceberg☆26Updated 4 years ago
- Extensible streaming ingestion pipeline on top of Apache Spark☆44Updated last year
- An application that records stats about consumer group offset commits and reports them as prometheus metrics☆14Updated 5 years ago
- A library for strong, schema based conversion between 'natural' JSON documents and Avro☆18Updated last year
- Rokku project. This project acts as a proxy on top of any S3 storage solution providing services like authentication, authorization, shor…☆66Updated last month
- Using the Parquet file format (with Avro) to process data with Apache Flink☆14Updated 9 years ago
- Spark stream from kafka(json) to s3(parquet)☆15Updated 6 years ago
- A highly available and infinitely scalable, drop-in replacement for Kafka Streams☆17Updated this week
- ☆26Updated 5 years ago
- Example Spark applications that run on Kubernetes and access GCP products, e.g., GCS, BigQuery, and Cloud PubSub☆37Updated 7 years ago
- Paper: A Zero-rename committer for object stores☆20Updated 3 years ago
- A Transactional Metadata Store Backed by Apache Kafka☆23Updated this week
- An Operator for scheduling and executing NiFi Flows as Jobs on Kubernetes☆53Updated 4 years ago
- Spark pipelines that correspond to a series of Dataflow examples.☆27Updated 5 years ago
- HDFS compatible Distributed Filesystem backed Cassandra☆25Updated 9 years ago
- Pulsar consumer clients offering priority consumption☆11Updated 2 years ago
- Kafka to Avro Writer based on Apache Beam. It's a generic solution that reads data from multiple kafka topics and stores it on in cloud s…☆25Updated 4 years ago
- Runs JVM closures in Docker containers on Kubernetes☆36Updated 7 years ago
- Lenses.io JDBC driver for Apache Kafka☆21Updated 3 years ago
- A small project to allow publishing data to Apache Kafka, Apache Pulsar or any other target system☆14Updated 4 years ago
- ☆81Updated last year
- Example program that writes Parquet formatted data to plain files (i.e., not Hadoop hdfs); Parquet is a columnar storage format.☆38Updated 2 years ago
- Apache Amaterasu☆56Updated 5 years ago
- Java/Scala library for easily authoring Flyte tasks and workflows☆44Updated 2 months ago