DBeam exports SQL tables into Avro files using JDBC and Apache Beam
☆197Oct 23, 2026Updated last week
Alternatives and similar repositories for dbeam
Users that are interested in dbeam are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A Scala API for Apache Beam and Google Cloud Dataflow.☆2,631Oct 23, 2026Updated last week
- "The path to execution", Styx is a service that schedules batch data processing jobs in Docker containers on Kubernetes.☆270Jul 12, 2023Updated 3 years ago
- GCS support for avro-tools, parquet-tools and protobuf☆80Jul 14, 2026Updated 3 months ago
- ☆54Aug 3, 2017Updated 9 years ago
- Export PostgreSQL tables to Google BigQuery☆37Jun 14, 2021Updated 5 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- A unified way of launching Dataflow jobs☆13Apr 17, 2023Updated 3 years ago
- A Scala feature transformation library for data science and machine learning☆475Oct 15, 2026Updated 2 weeks ago
- Useful Cloud Dataflow custom templates.☆16Dec 14, 2022Updated 3 years ago
- ☆67Aug 16, 2024Updated 2 years ago
- Processing Logs at Scale using Cloud Dataflow☆60Mar 18, 2019Updated 7 years ago
- gRPC Kotlin template project for getting started building clients and services using Kotlin Coroutines and kroto-plus code generation.☆12Sep 1, 2019Updated 7 years ago
- Repository with examples and smoke tests for the GCP Airflow operators and hooks☆152Jan 15, 2017Updated 9 years ago
- Sources for Havlak Benchmark for several JVM Languages☆14Mar 23, 2014Updated 12 years ago
- Groovy DSL for Apache oozie workflow☆12Jul 29, 2013Updated 13 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Vision analytics solution using Dataflow and Vision AI☆16May 4, 2024Updated 2 years ago
- Hadoop Management System☆16Dec 2, 2025Updated 10 months ago
- A command-line tool for managing permissions and dependencies for BigQuery authorized views☆92May 21, 2022Updated 4 years ago
- DEPRECATED. PLEASE USE https://github.com/confluentinc/kafka-connect-bigquery. A Kafka Connect BigQuery sink connector☆151Mar 4, 2024Updated 2 years ago
- protoc-gen-bq-schema helps you to send your Protocol Buffer messages to BigQuery.☆262Oct 29, 2025Updated last year
- CLI to tail Cloud Spanner change streams☆25Sep 18, 2026Updated last month
- Clojure Transit Tracker☆20Aug 5, 2022Updated 4 years ago
- A PyPI compatible server running on App Engine☆12Nov 13, 2017Updated 8 years ago
- Google BigQuery support for Spark, Structured Streaming, SQL, and DataFrames with easy Databricks integration.☆70May 8, 2023Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Apache Beam is a unified programming model for Batch and Streaming data processing.☆8,703Updated this week
- Code snippets for solving common big data problems in various platforms. Inspired by Rosetta Code☆297Sep 23, 2026Updated last month
- Shapeless utilities for common data types☆68Oct 19, 2026Updated last week
- ☆80Nov 10, 2023Updated 2 years ago
- Iceberg is a table format for large, slow-moving tabular data☆494Apr 10, 2023Updated 3 years ago
- Provides different code samples for Apache Beam and DataFlow☆14Sep 29, 2023Updated 3 years ago
- This library has moved to https://github.com/googleapis/google-cloud-java/tree/main/java-automl.☆13Jul 10, 2023Updated 3 years ago
- Multi Cloud Data Tokenization Solution By Using Dataflow and Cloud DLP☆100Aug 13, 2024Updated 2 years ago
- ☆84Jan 26, 2026Updated 9 months ago
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- ☆37Mar 22, 2023Updated 3 years ago
- Distributed Big Data Orchestration Service☆1,767Sep 30, 2026Updated last month
- Yet-Another-Rules-Engine -- A easy-to-understand Business Readable DSL for defining production rules.☆14Mar 24, 2021Updated 5 years ago
- A custom watcher plugin for Elasticsearch that feeds Apache Kafka☆11Mar 9, 2018Updated 8 years ago
- An example of Akka application that uses Scaldi for dependency injection☆10Dec 11, 2015Updated 10 years ago
- Integration for Cascading and Apache Hive☆25Oct 31, 2017Updated 9 years ago
- Cloud Dataflow Google-provided templates for solving in-Cloud data tasks☆1,319Updated this week