Data Pipeline Clientlib provides an interface to tail and publish to data pipeline topics.
☆109Aug 17, 2022Updated 4 years ago
Alternatives and similar repositories for data_pipeline
Users that are interested in data_pipeline are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A schema store service that tracks and manages all the schemas used in the Data Pipeline☆87Mar 2, 2021Updated 5 years ago
- Provides a Pythonic interface for reading and writing Avro schemas☆27Aug 17, 2022Updated 4 years ago
- MySQLStreamer is a database change data capture and publish system.☆408Aug 17, 2022Updated 4 years ago
- An extension of the kafka-python package that adds features like multiprocess consumers.☆39Aug 24, 2023Updated 3 years ago
- ☆42Aug 17, 2022Updated 4 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Preview markdown files in the browser from vim☆10Oct 20, 2013Updated 13 years ago
- requirements-tools contains scripts for working with Python requirements, primarily in applications.☆83Mar 24, 2023Updated 3 years ago
- A Python library for variable type checker/validator/converter at a run time.☆17Jul 20, 2026Updated 3 months ago
- HA Distributed System to transactionally move data from Sources (eg Kafka) to Sinks ( eg Hadoop HDFS )☆11Jun 23, 2018Updated 8 years ago
- Use Terraform outputs in your ruby code.☆11Feb 5, 2020Updated 6 years ago
- Cassandra Dataset Manager☆14Sep 1, 2017Updated 9 years ago
- SamzaSQL: Streaming SQL implementation on top of Apache Samza and Apache Kafka☆30Jun 8, 2016Updated 10 years ago
- Scala HTTP/SOCKS proxy library, based on akka-streams☆10Nov 3, 2018Updated 7 years ago
- Kafka Connect Connector for Jenkins Open Source Continuous Integration Tool☆31Nov 15, 2022Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☕⛵WIP PySpark dependency management☆22Jul 8, 2018Updated 8 years ago
- React version of dbt labs dbt docs app☆18Nov 14, 2021Updated 4 years ago
- Apache DistributedLog☆188Apr 17, 2023Updated 3 years ago
- Tranquility helps you send real-time event streams to Druid and handles partitioning, replication, service discovery, and schema rollover…☆13May 3, 2019Updated 7 years ago
- Sample Spark Code☆91Sep 19, 2018Updated 8 years ago
- A basic flask app to test Kubernetes☆11Oct 19, 2018Updated 8 years ago
- Ansible Role for MySQL/MariaDB/Percona Backup using mysqldump☆12Jul 16, 2019Updated 7 years ago
- Template of a Spark project, with IDEA support, bundling with assembly, examples, ...☆10Mar 20, 2015Updated 11 years ago
- Capture, save, and analyze AWS Redshift performance metrics☆17Oct 6, 2017Updated 9 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Red/black tree with support for fast accumulation of values in a key range☆18Sep 26, 2024Updated 2 years ago
- This is the Go implementation of Money☆14Jan 12, 2024Updated 2 years ago
- hodor☆19Jun 21, 2024Updated 2 years ago
- Marquez Web UI☆21Nov 13, 2020Updated 5 years ago
- Mirror of Apache Crunch (Incubating)☆110Feb 2, 2021Updated 5 years ago
- Code for SNQL, an app and data pipeline to track my sneaker habits☆11Oct 20, 2019Updated 7 years ago
- Builds Airflow DAGs from configuration files. Powers all DAGs on the Etsy Data Platform☆260Jul 19, 2023Updated 3 years ago
- ☆14Aug 21, 2021Updated 5 years ago
- pgsnap is a PostgreSQL tool that mimics orasnap performance report tool for Oracle.☆18Apr 4, 2016Updated 10 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Next generation batch process scheduling and management☆354Updated this week
- Deploy an AWS Lambda function to delete backing snapshots when an AMI is deregistered.☆12Oct 28, 2019Updated 7 years ago
- Monitor docker Swarm services and sends a pushover notification if anyone is down☆21Nov 27, 2019Updated 6 years ago
- A python library for converting XML documents to XSD schemas.☆13Updated this week
- Real-Time Data Processing Pipeline & Visualization with Docker, Spark, Kafka and Cassandra☆85May 4, 2017Updated 9 years ago
- Blogpost☆10Mar 2, 2018Updated 8 years ago
- 12 Week Data Science Immersive☆29May 13, 2015Updated 11 years ago