rjurney / Collecting-DataLinks
This is a HOWTO for collecting data in Ruby and Python applications and sending it to S3 via Kafka.
☆31Updated 13 years ago
Alternatives and similar repositories for Collecting-Data
Users that are interested in Collecting-Data are comparing it to the libraries listed below
Sorting:
- JSON -> Relational DB Column Types☆63Updated 3 years ago
- Empower Curiosity / Redshift analytics platform☆76Updated 4 years ago
- Originally for monthly table partitions, more info at [imperialwicket.com](http://imperialwicket.com/postgresql-automating-monthly-table-…☆43Updated 10 years ago
- ☆54Updated 8 years ago
- Dynamic Visualization LEGO☆128Updated last year
- Scheduled task execution on top of AWS Data Pipeline☆43Updated 10 years ago
- A tool for moving tables from Redshift to BigQuery☆65Updated 7 years ago
- A Python wrapper for Cascading☆221Updated 6 years ago
- Data Pipeline Clientlib provides an interface to tail and publish to data pipeline topics.☆110Updated 3 years ago
- A schema store service that tracks and manages all the schemas used in the Data Pipeline☆88Updated 4 years ago
- Core OJAI APIs☆47Updated 2 years ago
- Bulk loading for elastic search☆185Updated 2 years ago
- Ferry lets you define, run, and deploy big data applications on AWS, OpenStack, and your local machine using Docker☆254Updated 10 years ago
- S3 backed ContentsManager for jupyter notebooks☆14Updated 10 years ago
- Open source Flotilla☆195Updated last week
- Chapter-wise code for Agile Data the O'Reilly book☆159Updated 12 years ago
- A very simple django site for demonstrating the use of rpy for plotting☆64Updated 11 years ago
- SQL for many helpful Redshift UDFs, and the scripts for generating and testing those UDFs☆125Updated 7 years ago
- A Seriously Fun guide to Big Data Analytics in Practice☆169Updated 10 years ago
- TweeQL is a Query Language for Tweets: SELECT brand(text) AS brand, sentiment(text) AS sentiment FROM twitter_sample;☆193Updated 11 years ago
- Open source analytics platform powered by Apache Cassandra, Spark, and Kafka☆34Updated 10 years ago
- A platform for real-time streaming search☆102Updated 9 years ago
- Run templatable playbooks of SQL scripts in series and parallel on Redshift, PostgreSQL, BigQuery and Snowflake☆81Updated 8 months ago
- Zohmg is a data store for aggregation of multi-dimensional time series data, built on top of Hadoop, Dumbo and HBase.☆173Updated 13 years ago
- A set of tools for working with Omniture daily data files (hit_data.tsv) in big or small tools like Spark, Hadoop or just Python.☆38Updated 6 years ago
- A restful web application for real-time typeahead and autocomplete☆105Updated 12 years ago
- A bunch of utility classes for Java, Hadoop, HBase, Pig, etc.☆76Updated 11 years ago
- Airflow workflow management platform chef cookbook.☆70Updated 6 years ago
- Piglet is a DSL for writing Pig scripts in Ruby☆83Updated 15 years ago
- Postgresql utilities for ETL and data analysis☆24Updated 8 years ago