Example project to show how to use Spark to read and write Avro/Parquet files
☆50Aug 21, 2013Updated 12 years ago
Alternatives and similar repositories for spark-parquet-example
Users that are interested in spark-parquet-example are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- An example of using Avro and Parquet in Spark SQL☆60Nov 16, 2015Updated 10 years ago
- This is an introduction of Apache Spark DataFrames.☆41Mar 12, 2015Updated 11 years ago
- Simple Spark app that reads and writes Avro data☆31Apr 13, 2015Updated 11 years ago
- ☆21Oct 1, 2015Updated 10 years ago
- Sample custom Nifi processor to process tcpdump☆18Nov 19, 2015Updated 10 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- A subproject of Predictiveworks that provides common access to Cassandra, Elasticsearch, HBase, MongoDB, Parquet, JDBC database and other…☆13Feb 23, 2015Updated 11 years ago
- Single view demo☆14Feb 13, 2016Updated 10 years ago
- Example integration of Kafka, Avro & Spark-Streaming on live Twitter feed☆22Jan 23, 2015Updated 11 years ago
- ☆48Feb 4, 2018Updated 8 years ago
- An Akka Extension for easy integration of spark and cassandra in Akka micro services.☆25Sep 25, 2014Updated 11 years ago
- Materials and Jekyll website for the Wednesday software working group.☆10Feb 17, 2017Updated 9 years ago
- Integrate the GA4GH schemas and probably a scala impl of the service.☆14May 20, 2016Updated 9 years ago
- Examples for Fast Data Processing with Spark☆59Sep 10, 2013Updated 12 years ago
- Hadoop MapReduce tool to convert Avro data files to Parquet format.☆32May 22, 2013Updated 12 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Scripts to launch cluster used for Strata☆33Feb 11, 2014Updated 12 years ago
- A Real-Time Analytical Processing (RTAP) example using Spark/Shark☆51Feb 21, 2014Updated 12 years ago
- ☆17Oct 20, 2017Updated 8 years ago
- Examples of Integrating Spark Streaming, Flume, and HBase to solve Streaming problems☆19Feb 27, 2014Updated 12 years ago
- Spark Extension : ML transformers, SQL aggregations, etc that are missing in Apache Spark☆146Jan 26, 2016Updated 10 years ago
- Code and setup information for Introduction to Machine Learning with Spark☆12Sep 4, 2015Updated 10 years ago
- Example MapReduce jobs in Java, Hive, Pig, and Hadoop Streaming that work on Avro data.☆115Nov 12, 2015Updated 10 years ago
- Machine Learning over Twitter's stream. Using Apache Spark, Web Server and Lightning Graph server.☆27Jun 19, 2016Updated 9 years ago
- Cucumber-based framework for defining and executing SQL unit, integration and acceptance tests (for AWS Redshift, PostgreSQL)☆13Sep 30, 2020Updated 5 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Scripts for generating Grafana dashboards for monitoring Spark jobs☆241Mar 26, 2015Updated 11 years ago
- Experiments made with Spark☆15Dec 9, 2014Updated 11 years ago
- Additional useful algorithms that can be used with spark.☆24Dec 24, 2014Updated 11 years ago
- API Gateway for *.ik.am☆15Jun 10, 2021Updated 4 years ago
- This sample demonstrates how to make a use of modules provided by Microsoft Azure File Service in Python.☆11Apr 21, 2021Updated 5 years ago
- Databricks Spark 知识库简体中文版☆34Dec 8, 2014Updated 11 years ago
- kudu学习的一些资料，以及和spark/impala的集成使用☆34Sep 11, 2017Updated 8 years ago
- Based off the design of SparkOnHBase. This Repo will support Spark, Spark Streaming, and Spark SQL integration with Kudu.☆50May 19, 2016Updated 9 years ago
- Pandas Helper Library for reading and writing DataFrames from and to HBase.☆10Mar 8, 2018Updated 8 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- A Storm based web crawler with Cassandra backend☆29Nov 7, 2013Updated 12 years ago
- My 2nd place submission (working with Kevin Goetsch) out of 28 teams at the Kaggle competition at PyCon2015.☆23Apr 17, 2015Updated 11 years ago
- SequenceIQ Hadoop examples☆115Oct 26, 2015Updated 10 years ago
- SparkStreaming中利用MySQL保存Kafka偏移量保证0数据丢失☆43Aug 2, 2017Updated 8 years ago
- ☆39Aug 19, 2015Updated 10 years ago
- ☆14Nov 3, 2016Updated 9 years ago
- A rough prototype of a tool for discovering Apache Hive schemas from JSON documents.☆43Dec 16, 2023Updated 2 years ago