Data Pipeline Clientlib provides an interface to tail and publish to data pipeline topics.
☆109Aug 17, 2022Updated 4 years ago
Alternatives and similar repositories for data_pipeline
Users that are interested in data_pipeline are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A schema store service that tracks and manages all the schemas used in the Data Pipeline☆88Mar 2, 2021Updated 5 years ago
- Provides a Pythonic interface for reading and writing Avro schemas☆27Aug 17, 2022Updated 4 years ago
- MySQLStreamer is a database change data capture and publish system.☆411Aug 17, 2022Updated 4 years ago
- An extension of the kafka-python package that adds features like multiprocess consumers.☆39Aug 24, 2023Updated 3 years ago
- Terraform AWS ECS stack☆13May 29, 2020Updated 6 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A Python library for variable type checker/validator/converter at a run time.☆17Jul 20, 2026Updated last month
- Interfaces and shared infrastructure for generic task processing at Yelp.☆23May 15, 2026Updated 3 months ago
- Easy-to-install monitor endpoint for Tornado applications☆46May 28, 2024Updated 2 years ago
- Scala HTTP/SOCKS proxy library, based on akka-streams☆10Nov 3, 2018Updated 7 years ago
- Go Plug-ins & Vendored Dependencies: A Solution☆11Jun 1, 2017Updated 9 years ago
- Kafka Connect Connector for Jenkins Open Source Continuous Integration Tool☆31Nov 15, 2022Updated 3 years ago
- ☕⛵WIP PySpark dependency management☆22Jul 8, 2018Updated 8 years ago
- Code & data for Fast data processing with Spark V2☆14Feb 1, 2015Updated 11 years ago
- requirements-tools contains scripts for working with Python requirements, primarily in applications.☆83Mar 24, 2023Updated 3 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Last-seen sketch implementation in Go☆16Dec 15, 2020Updated 5 years ago
- Sample Spark Code☆91Sep 19, 2018Updated 7 years ago
- a dbt package to make auditing dbt runs easy.☆99Dec 4, 2024Updated last year
- Template of a Spark project, with IDEA support, bundling with assembly, examples, ...☆10Mar 20, 2015Updated 11 years ago
- Apache DistributedLog☆188Apr 17, 2023Updated 3 years ago
- Jupyter Integration for MATLAB using VNC☆17Sep 26, 2025Updated 11 months ago
- http://hg.furius.ca/public/snakefood/☆11Oct 30, 2014Updated 11 years ago
- ☆14Jun 25, 2020Updated 6 years ago
- A DataFusion-powered Serverless S3 Proxy.☆17Apr 15, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Code for SNQL, an app and data pipeline to track my sneaker habits☆11Oct 20, 2019Updated 6 years ago
- A helper script for continuous testing written in Python☆29May 11, 2023Updated 3 years ago
- Monitor docker Swarm services and sends a pushover notification if anyone is down☆21Nov 27, 2019Updated 6 years ago
- Skeleton project for Apache Airflow training participants to work on.☆17Apr 13, 2026Updated 4 months ago
- Just a collection of my Jenkins Groovy nonsense (especially Job DSL scripts)☆13Jul 15, 2020Updated 6 years ago
- Astronomer Vendor Images☆19Updated this week
- A simple service discovery client for small architectures made in GO☆12Mar 15, 2016Updated 10 years ago
- Fault Tolerant Applications with Apache Cassandra™ Demo☆17Mar 20, 2023Updated 3 years ago
- Consumes Kafka topics specified in the config, and outputs them in chunks as desired in an S3 Bucket. Keeps track of offsets via S3.☆15Sep 6, 2013Updated 12 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Real-Time Data Processing Pipeline & Visualization with Docker, Spark, Kafka and Cassandra☆85May 4, 2017Updated 9 years ago
- a declarative ETL framework that enforces data engineer best practices☆40Aug 31, 2017Updated 9 years ago
- The Nuvolaris CLI, an all-in-one tool to do all things Nuvolaris☆11Mar 9, 2023Updated 3 years ago
- spark-emr☆15Apr 17, 2014Updated 12 years ago
- Define Netlify sites as part of an AWS Cloudformation stack.☆11Jun 5, 2021Updated 5 years ago
- Generate a Go file with the output of compile time shell commands☆19May 17, 2021Updated 5 years ago
- Big Data ETL and Utilities for Hadoop Map Reduce, Spark and Storm☆106Jan 22, 2024Updated 2 years ago