Data Pipeline Clientlib provides an interface to tail and publish to data pipeline topics.
☆109Aug 17, 2022Updated 4 years ago
Alternatives and similar repositories for data_pipeline
Users that are interested in data_pipeline are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A schema store service that tracks and manages all the schemas used in the Data Pipeline☆88Mar 2, 2021Updated 5 years ago
- Provides a Pythonic interface for reading and writing Avro schemas☆27Aug 17, 2022Updated 4 years ago
- MySQLStreamer is a database change data capture and publish system.☆410Aug 17, 2022Updated 4 years ago
- An extension of the kafka-python package that adds features like multiprocess consumers.☆39Aug 24, 2023Updated 3 years ago
- Twitter-Kafka Data Pipeline☆16Nov 19, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Manage sets of developer services -- "playground control"☆32Apr 2, 2026Updated 6 months ago
- Terraform AWS ECS stack☆13May 29, 2020Updated 6 years ago
- SamzaSQL: Streaming SQL implementation on top of Apache Samza and Apache Kafka☆30Jun 8, 2016Updated 10 years ago
- Use Terraform outputs in your ruby code.☆11Feb 5, 2020Updated 6 years ago
- Easy-to-install monitor endpoint for Tornado applications☆46May 28, 2024Updated 2 years ago
- Go Plug-ins & Vendored Dependencies: A Solution☆11Jun 1, 2017Updated 9 years ago
- Last-seen sketch implementation in Go☆16Dec 15, 2020Updated 5 years ago
- a dbt package to make auditing dbt runs easy.☆99Dec 4, 2024Updated last year
- Marquez Web UI☆21Nov 13, 2020Updated 5 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Streaming Data Simulator☆16Oct 12, 2020Updated 5 years ago
- ansible async web api with tornado☆10Apr 10, 2016Updated 10 years ago
- Template of a Spark project, with IDEA support, bundling with assembly, examples, ...☆10Mar 20, 2015Updated 11 years ago
- Unfinished work on a general-purpose Taskcluster worker☆19Feb 26, 2020Updated 6 years ago
- The Peloton CLI you never wanted☆11Oct 25, 2020Updated 5 years ago
- A DataFusion-powered Serverless S3 Proxy.☆17Apr 15, 2024Updated 2 years ago
- Deploy an AWS Lambda function to delete backing snapshots when an AMI is deregistered.☆12Oct 28, 2019Updated 6 years ago
- Process lines in parallel.☆22Jan 23, 2025Updated last year
- Synchronize Postgres to Snowflake in near-real time with one simple application☆12Nov 27, 2023Updated 2 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Skeleton project for Apache Airflow training participants to work on.☆17Apr 13, 2026Updated 5 months ago
- Create stacks (aka stax) on AWS (Amazon Web Services) in a private VPC (Virtual Private Cloud) with failover NAT nodes proxying network t…☆18Feb 20, 2019Updated 7 years ago
- Astronomer Vendor Images☆19Updated this week
- A simple service discovery client for small architectures made in GO☆12Mar 15, 2016Updated 10 years ago
- Consumes Kafka topics specified in the config, and outputs them in chunks as desired in an S3 Bucket. Keeps track of offsets via S3.☆15Sep 6, 2013Updated 13 years ago
- ☆15Jan 31, 2018Updated 8 years ago
- a declarative ETL framework that enforces data engineer best practices☆40Aug 31, 2017Updated 9 years ago
- ulog - Structured and context based logging for golang☆27Sep 3, 2019Updated 7 years ago
- spark-emr☆15Apr 17, 2014Updated 12 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- pyspark-shared-spark-session-helper☆14Aug 29, 2024Updated 2 years ago
- DEPRECATED☆13Jan 8, 2016Updated 10 years ago
- Agent for twemproxy to work with a redis sentinel to provide support for failover☆18Mar 26, 2015Updated 11 years ago
- A dbt adapter for TiDB☆15Dec 14, 2023Updated 2 years ago
- ☆11Aug 3, 2021Updated 5 years ago
- One stop shop for monitoring, logging, and alerts.☆27Jan 23, 2017Updated 9 years ago
- Documentation and resources for deploying JupyterHub on Hadoop☆19Jul 16, 2019Updated 7 years ago