rjurney / Collecting-DataLinks
This is a HOWTO for collecting data in Ruby and Python applications and sending it to S3 via Kafka.
☆31Updated 13 years ago
Alternatives and similar repositories for Collecting-Data
Users that are interested in Collecting-Data are comparing it to the libraries listed below
Sorting:
- JSON -> Relational DB Column Types☆63Updated 3 years ago
- Empower Curiosity / Redshift analytics platform☆76Updated 4 years ago
- A tool for moving tables from Redshift to BigQuery☆65Updated 7 years ago
- Scheduled task execution on top of AWS Data Pipeline☆43Updated 10 years ago
- ☆54Updated 8 years ago
- SQL for many helpful Redshift UDFs, and the scripts for generating and testing those UDFs☆125Updated 7 years ago
- Originally for monthly table partitions, more info at [imperialwicket.com](http://imperialwicket.com/postgresql-automating-monthly-table-…☆43Updated 10 years ago
- Data Pipeline Clientlib provides an interface to tail and publish to data pipeline topics.☆110Updated 3 years ago
- Arbalest is a Python data pipeline orchestration library for Amazon S3 and Amazon Redshift. It automates data import into Redshift and ma…☆40Updated 10 years ago
- Airflow script for incremental data import from Mysql to Hive using Sqoop.☆18Updated 7 years ago
- S3 backed ContentsManager for jupyter notebooks☆14Updated 10 years ago
- Bulk loading for elastic search☆185Updated 2 years ago
- Postgresql utilities for ETL and data analysis☆24Updated 8 years ago
- Dynamic Visualization LEGO☆128Updated last year
- Open source analytics platform powered by Apache Cassandra, Spark, and Kafka☆34Updated 10 years ago
- DataPipeline for humans.☆250Updated 3 years ago
- Core OJAI APIs☆47Updated 2 years ago
- ☆78Updated 3 years ago
- Redshift Ops Console☆92Updated 10 years ago
- Run templatable playbooks of SQL scripts in series and parallel on Redshift, PostgreSQL, BigQuery and Snowflake☆81Updated 8 months ago
- A very simple django site for demonstrating the use of rpy for plotting☆64Updated 11 years ago
- code for my O'Reilly masterclass videos☆312Updated 11 years ago
- A REST API for Mozilla Metrics services.☆57Updated 6 years ago
- Data pipeline is a tool to run Data loading pipelines. It is an open sourced app engine app that users can extend to suit their own needs…☆87Updated 12 years ago
- A schema store service that tracks and manages all the schemas used in the Data Pipeline☆88Updated 4 years ago
- Cohort visualizer – A handy tool for browsing cohort datasets☆267Updated 4 years ago
- Airflow workflow management platform chef cookbook.☆70Updated 6 years ago
- Zohmg is a data store for aggregation of multi-dimensional time series data, built on top of Hadoop, Dumbo and HBase.☆173Updated 13 years ago
- Repo for the Stitch Docs☆58Updated last week
- Data visualization for your database.☆82Updated 11 years ago