A complete example of a big data application using : Kubernetes (kops/aws), Apache Spark SQL/Streaming/MLib, Apache Flink, Scala, Python, Apache Kafka, Apache Hbase, Apache Parquet, Apache Avro, Apache Storm, Twitter Api, MongoDB, NodeJS, Angular, GraphQL
☆210Feb 1, 2019Updated 7 years ago
Alternatives and similar repositories for bigdata-playground
Users that are interested in bigdata-playground are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Slowly Changing Dimension type 2 using Hive query language using exclusive join technique with ORC Hive tables, partitioned and clustered…☆16May 11, 2019Updated 7 years ago
- A short course on the new, experimental features by The Data Incubator and O'Reilly Strata.☆16Jan 25, 2017Updated 9 years ago
- Run TPC-DS against different databases including Hive, Spark SQL and IBM BigSQL☆14Jan 4, 2022Updated 4 years ago
- Spark structured streaming with Kafka data source and writing to Cassandra☆62Dec 5, 2019Updated 6 years ago
- Industrial IoT (IIoT) Integration and Data Processing with Apache PLC4X, Kafka Connect, KSQL (OPC-UA, Modbus, Siemens S7)☆34Aug 30, 2019Updated 7 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Self-contained examples of Apache Spark streaming integrated with Apache Kafka.☆196Apr 15, 2018Updated 8 years ago
- ☆10Jun 9, 2019Updated 7 years ago
- Flink Forward 201709☆43Oct 20, 2017Updated 8 years ago
- Spark implementation of Slowly Changing Dimension type 2☆10Jan 8, 2019Updated 7 years ago
- Docker container for Kafka - Spark Streaming - Cassandra☆96Jun 17, 2019Updated 7 years ago
- basic postgres load generator☆11Sep 28, 2018Updated 7 years ago
- Spark Structured Streaming / Kafka / Cassandra / Elastic☆185Feb 7, 2023Updated 3 years ago
- Source code for 'BigQuery for Data Warehousing' by Mark Mucchetti☆16Sep 28, 2020Updated 5 years ago
- A generic data pipeline which will map Elasticsearch documents to Bigquery table rows☆14Sep 29, 2019Updated 6 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆104Nov 26, 2019Updated 6 years ago
- flink-jpmml is a fresh-made library for dynamic real time machine learning predictions built on top of PMML standard models and Apache Fl…☆97May 9, 2019Updated 7 years ago
- bigquery patterns☆14Aug 11, 2017Updated 9 years ago
- Hadoop, MapReduce, HDFS, Spark, Pig, Hive, HBase, MongoDB, Cassandra, Flume - the list goes on! Over 25 technologies.☆10Jan 1, 2018Updated 8 years ago
- Spark Streaming ETL jobs for Mozilla Telemetry☆18Dec 5, 2019Updated 6 years ago
- Analyze and visualize Twitter Sentiment on a world map using Spark MLlib☆143Apr 27, 2021Updated 5 years ago
- Benchmarking read performance of PostgreSQL and MongoDB on same data sets.☆16Aug 14, 2018Updated 8 years ago
- 📄🚀 Unleash a powerful Document Search Engine with Apache NiFi for lightning-fast, comprehensive text indexing and search.☆30Nov 26, 2025Updated 9 months ago
- Snowflake scripts and useful snippets☆16Feb 2, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Scripts complement the Optimizing a Data Vault data warehouse on the Snowflake Cloud Data Platform webinar☆16Oct 8, 2020Updated 5 years ago
- Apache Flink docker image☆196Jul 1, 2022Updated 4 years ago
- Scala examples for learning to use Spark☆442Sep 17, 2020Updated 5 years ago
- Structured Streaming Machine Learning example with Spark 2.0☆95Apr 24, 2017Updated 9 years ago
- Code repository for Large Scale Machine Learning with Spark by Packt☆20Oct 31, 2022Updated 3 years ago
- Kubernetes CephFS PV Provisioner☆13Mar 31, 2017Updated 9 years ago
- Spark Connector to read and write with Pulsar☆120May 26, 2026Updated 3 months ago
- Get Twitter trends with twitter4j, stream it to a Kafka topic, save it to MongoDB and visualize in Google Maps☆13Sep 30, 2021Updated 4 years ago
- ☆12Aug 19, 2021Updated 5 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆11Nov 17, 2020Updated 5 years ago
- Analytics engineering with dbt - projects and developer environment☆24Sep 27, 2024Updated last year
- A Soccer Dashboard created by scraping EPL website using Akka backend and ReactJS frontend and IBM Cloudant for object storage. IBM Cloud…☆20Feb 14, 2022Updated 4 years ago
- Control self balancing robot WowWee MiP from ScratchX☆12Dec 6, 2022Updated 3 years ago
- Delta Lake Examples☆11Apr 24, 2020Updated 6 years ago
- The official repository for the Rock the JVM Spark Optimization 2 course☆46Jun 20, 2026Updated 2 months ago
- Live Twitter sentiment analysis using Python, Apache Spark Streaming, Kafka, NLTK, SocketIO☆20Oct 10, 2017Updated 8 years ago