A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL
☆210Feb 1, 2019Updated 7 years ago
Alternatives and similar repositories for bigdata-playground
Users that are interested in bigdata-playground are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A micro-service infrastructure generator based on Yeoman/Chatbot, Kubernetes/Docker Swarm, Traefik, Ansible, Jenkins, Spark, Hadoop, Kafk…☆81Dec 6, 2022Updated 3 years ago
- Slowly Changing Dimension type 2 using Hive query language using exclusive join technique with ORC Hive tables, partitioned and clustered…☆16May 11, 2019Updated 7 years ago
- Run TPC-DS against different databases including Hive, Spark SQL and IBM BigSQL☆14Jan 4, 2022Updated 4 years ago
- Spark structured streaming with Kafka data source and writing to Cassandra☆62Dec 5, 2019Updated 6 years ago
- Industrial IoT (IIoT) Integration and Data Processing with Apache PLC4X, Kafka Connect, KSQL (OPC-UA, Modbus, Siemens S7)☆34Aug 30, 2019Updated 7 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Flink Forward 201709☆43Oct 20, 2017Updated 8 years ago
- Spark implementation of Slowly Changing Dimension type 2☆10Jan 8, 2019Updated 7 years ago
- Text Analytics Pipeline (TAP)☆17Jan 4, 2026Updated 8 months ago
- Docker container for Kafka - Spark Streaming - Cassandra☆96Jun 17, 2019Updated 7 years ago
- Building Microservices with Spring Boot☆14May 7, 2015Updated 11 years ago
- basic postgres load generator☆11Sep 28, 2018Updated 7 years ago
- A set of scripts useful for managing Unix/Linux Oracle database environments.☆11Dec 13, 2022Updated 3 years ago
- Spark Structured Streaming / Kafka / Cassandra / Elastic☆185Feb 7, 2023Updated 3 years ago
- Source code for 'BigQuery for Data Warehousing' by Mark Mucchetti☆16Sep 28, 2020Updated 5 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- A generic data pipeline which will map Elasticsearch documents to Bigquery table rows☆14Sep 29, 2019Updated 6 years ago
- JSoup extensions for Scala☆12Jun 1, 2021Updated 5 years ago
- flink-jpmml is a fresh-made library for dynamic real time machine learning predictions built on top of PMML standard models and Apache Fl…☆97May 9, 2019Updated 7 years ago
- bigquery patterns☆14Aug 11, 2017Updated 9 years ago
- Hadoop, MapReduce, HDFS, Spark, Pig, Hive, HBase, MongoDB, Cassandra, Flume - the list goes on! Over 25 technologies.☆10Jan 1, 2018Updated 8 years ago
- Spark Streaming ETL jobs for Mozilla Telemetry☆18Dec 5, 2019Updated 6 years ago
- Simple demonstration of how to build a complex real time machine learning visualization tool.☆16Mar 26, 2016Updated 10 years ago
- Benchmarking read performance of PostgreSQL and MongoDB on same data sets.☆16Aug 14, 2018Updated 8 years ago
- 📄🚀 Unleash a powerful Document Search Engine with Apache NiFi for lightning-fast, comprehensive text indexing and search.☆30Nov 26, 2025Updated 10 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Scripts complement the Optimizing a Data Vault data warehouse on the Snowflake Cloud Data Platform webinar☆16Oct 8, 2020Updated 5 years ago
- Apache Flink docker image☆196Jul 1, 2022Updated 4 years ago
- BigQuery Schema Conversion Tool☆24Oct 6, 2020Updated 5 years ago
- Structured Streaming Machine Learning example with Spark 2.0☆96Apr 24, 2017Updated 9 years ago
- Experiments produced during an end of studies project (ETS, H2018)☆14Nov 21, 2018Updated 7 years ago
- Spark Connector to read and write with Pulsar☆120May 26, 2026Updated 4 months ago
- Get Twitter trends with twitter4j, stream it to a Kafka topic, save it to MongoDB and visualize in Google Maps☆13Sep 30, 2021Updated 4 years ago
- Ansible playbooks to construct distributed computing environments☆62Jun 6, 2021Updated 5 years ago
- A Soccer Dashboard created by scraping EPL website using Akka backend and ReactJS frontend and IBM Cloudant for object storage. IBM Cloud…☆20Feb 14, 2022Updated 4 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Control self balancing robot WowWee MiP from ScratchX☆12Dec 6, 2022Updated 3 years ago
- Live Twitter sentiment analysis using Python, Apache Spark Streaming, Kafka, NLTK, SocketIO☆20Oct 10, 2017Updated 8 years ago
- Docker Image and Kubernetes Configurations for Spark 2.x☆40Oct 27, 2019Updated 6 years ago
- Apache Spark™ and Scala Workshops☆264Jul 29, 2024Updated 2 years ago
- HDFS / Spark / Mesos / Elasticsearch / Kibana / Zeppelin BigDataLab with Ansible☆31Sep 12, 2016Updated 10 years ago
- 基于Flink+ClickHouse实时计算平台☆30Jun 21, 2022Updated 4 years ago
- Manage Apache Atlas and Ranger configuration for your Hadoop environment.☆16May 4, 2021Updated 5 years ago