dvryaboy / idl_storage_guidelinesLinks
This document attempts to capture useful patterns and warn about subtle gotchas when it comes to designing and evolving schemas for long-term serialized data. It is not intended as a guide for how to best represent a particular dataset or process.
☆13Updated 8 years ago
Alternatives and similar repositories for idl_storage_guidelines
Users that are interested in idl_storage_guidelines are comparing it to the libraries listed below
Sorting:
- Bullet is a streaming query engine that can be plugged into any singular data stream using a Stream Processing framework like Apache Stor…☆42Updated 2 years ago
- An application that records stats about consumer group offset commits and reports them as prometheus metrics☆14Updated 6 years ago
- Graph Analytics with Apache Kafka☆106Updated last week
- ☆21Updated 2 years ago
- Kafka End to End Encryption☆52Updated 2 years ago
- Export Airflow metrics (from mysql) in prometheus format☆29Updated 7 months ago
- A Kafka-Connect Sink for S3 with no Hadoop dependencies.☆57Updated 2 years ago
- ## Auto-archived due to inactivity. ## Simple JVM Profiler Using StatsD and Other Metrics Backends☆15Updated 2 years ago
- Java event logs collector for hadoop and frameworks☆41Updated 7 months ago
- Use SQL to transform your avro schema/records☆28Updated 7 years ago
- kafka-connect-s3 : Ingest data from Kafka to Object Stores(s3)☆95Updated 6 years ago
- Schema registry for CSV, TSV, JSON, AVRO and Parquet schema. Supports schema inference and GraphQL API.☆113Updated 5 years ago
- Mirus is a cross data-center data replication tool for Apache Kafka☆205Updated 4 months ago
- Simple Samza Job Using Confluent Platform☆14Updated 9 years ago
- Environment, operations and runtime-meta testing tool.☆90Updated 4 years ago
- Trivially Up a cluster of applications (such as a Kafka cluster!)☆49Updated last year
- Splittable Gzip codec for Hadoop☆74Updated last month
- Using the Parquet file format (with Avro) to process data with Apache Flink☆14Updated 10 years ago
- Kafka Connect Tooling☆117Updated 4 years ago
- Cassandra Node Diagnostics Tools☆50Updated 8 years ago
- Bash completion for Kafka command line utilities.☆36Updated 4 months ago
- No longer maintained. Use https://eventsizer.io instead.☆62Updated 6 years ago
- Dione - a Spark and HDFS indexing library☆52Updated 3 weeks ago
- Building Scio from scratch step by step☆20Updated 6 years ago
- Kafka sink connector for streaming messages to PostgreSQL☆92Updated 5 years ago
- Java/Scala library for easily authoring Flyte tasks and workflows☆44Updated 3 months ago
- Cantor provides utilities for estimating the cardinality of large sets.☆84Updated 3 years ago
- Schedoscope is a scheduling framework for painfree agile development, testing, (re)loading, and monitoring of your datahub, lake, or what…☆96Updated 6 years ago
- Rokku project. This project acts as a proxy on top of any S3 storage solution providing services like authentication, authorization, shor…☆70Updated 2 months ago
- JSON schema parser for Apache Spark☆82Updated 3 years ago