tosun-si / pasgarde
Asgarde allows simplifying error handling with Apache Beam Python, with less code, more concise and expressive code.
☆31Updated 2 years ago
Alternatives and similar repositories for pasgarde:
Users that are interested in pasgarde are comparing it to the libraries listed below
- Asgarde allows simplifying error handling with Apache Beam Java, with less code, more concise and expressive code.☆74Updated 8 months ago
- The Internals of Spark on Kubernetes☆71Updated 2 years ago
- Examples of Avro, Kafka, Schema Registry, Kafka Streams, Interactive Queries, KSQL, Kafka Connect in Scala☆63Updated 8 months ago
- A library that provides in-memory instances of both Kafka and Confluent Schema Registry to run your tests against.☆116Updated last month
- Airflow provider for use with Tecton.☆11Updated 7 months ago
- BigTesty is a framework that allows to create Integration Tests with BigQuery on a real and short lived Infrastructure.☆55Updated 9 months ago
- Java/Scala library for easily authoring Flyte tasks and workflows☆44Updated 2 months ago
- A library that provides an in-memory Kafka instance to run your tests against.☆395Updated last week
- Collection of transforms for the Apache beam python SDK.☆89Updated last year
- ☆31Updated 6 years ago
- Avro record class and reader generator☆20Updated 2 years ago
- ☆36Updated 2 years ago
- Scala DSL for Unit-Testing Processing Topologies in Kafka Streams☆186Updated 4 years ago
- ZIO for Python☆84Updated last year
- Oozie Workflow to Airflow DAGs migration tool☆87Updated last month
- Airflow Unit Tests and Integration Tests☆257Updated 2 years ago
- Flowchart for debugging Spark applications☆105Updated 6 months ago
- Nested array transformation helper extensions for Apache Spark☆37Updated last year
- Scala + Druid: Scruid. A library that allows you to compose queries in Scala, and parse the result back into typesafe classes.☆115Updated 3 years ago
- Delta reader for the Ray open-source toolkit for building ML applications☆45Updated last year
- A Giter8 template for scio☆31Updated 2 months ago
- protobuf pyspark conversion☆23Updated last year
- Poison pills and Kafka Streams demo☆10Updated 4 years ago
- Read and write Parquet in Scala. Use Scala classes as schema. No need to start a cluster.☆287Updated last month
- Pythonic Programming Framework to orchestrate jobs in Databricks Workflow☆215Updated this week
- Thin Scala wrapper around Kafka Streams Java API☆190Updated last year
- An open source library for BigQuery testing.☆14Updated 2 years ago
- PySpark schema generator☆42Updated 2 years ago
- ☆27Updated this week
- BigQuery data source for Apache Spark: Read data from BigQuery into DataFrames, write DataFrames into BigQuery tables.☆393Updated 2 weeks ago